[ 523.678698] env[66032]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.678698] env[66032]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.652564] env[66123]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 524.652564] env[66123]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 526.198449] env[66123]: INFO neutron.common.config [-] Logging enabled! [ 526.198737] env[66123]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev9 [ 526.199102] env[66123]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66123) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 526.199562] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 526.199724] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 526.200751] env[66123]: WARNING oslo_policy.policy [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 526.200959] env[66123]: WARNING oslo_policy.policy [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 526.202720] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] VMware NSXv3 Agent initialized successfully. [ 526.203110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] Acquiring lock "singleton_lock" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.203244] env[66123]: DEBUG oslo_concurrency.lockutils [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] Acquired lock "singleton_lock" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.203446] env[66123]: DEBUG oslo_concurrency.lockutils [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] Releasing lock "singleton_lock" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.203735] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] Full set of CONF: {{(pid=66123) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 526.203847] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ******************************************************************************** {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 526.203949] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] Configuration options gathered from: {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 526.204313] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 526.204504] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 526.204616] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ================================================================================ {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 526.204782] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] agent_down_time = 75 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.204954] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] allow_automatic_dhcp_failover = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.205113] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] allow_bulk = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.205256] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] api_extensions_path = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.205392] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] api_paste_config = api-paste.ini {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.205530] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] auth_strategy = keystone {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.205632] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] backdoor_port = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.205731] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] backdoor_socket = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.205862] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] backlog = 4096 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.206032] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.206196] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] bind_host = 0.0.0.0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.206371] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] bind_port = 9696 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.206586] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] client_socket_timeout = 900 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.206805] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] config_dir = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.206969] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.207220] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] config_source = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.207457] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] control_exchange = neutron {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.207701] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] core_plugin = ml2 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.207934] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] debug = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.208179] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] default_availability_zones = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.208526] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.208751] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] dhcp_agent_notification = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.208941] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] dhcp_agents_per_network = 1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.209105] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] dhcp_lease_duration = 86400 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.209253] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] dhcp_load_type = networks {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.209390] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] dns_domain = openstacklocal {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.209525] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.209658] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] enable_default_route_bfd = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.209786] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] enable_default_route_ecmp = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.209914] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] enable_dvr = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210051] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] enable_new_agents = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210182] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210311] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] enable_signals = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210437] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] enable_traditional_dhcp = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210563] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] external_dns_driver = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210688] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] filter_validation = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210824] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] global_physnet_mtu = 8950 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.210952] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] graceful_shutdown_timeout = 60 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.211146] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] host = cpu-1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.211285] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] host_dvr_for_dhcp = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.211456] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] http_retries = 3 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.211592] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] instance_format = [instance: %(uuid)s] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.211725] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.211857] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ipam_driver = internal {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.211987] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ipv6_pd_enabled = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.212126] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] l3_ha = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.212260] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.212417] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] l3_ha_network_physical_name = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.212555] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] l3_ha_network_type = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.212691] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_color = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.212824] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_config_append = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.212956] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213096] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_dir = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213222] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_file = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213322] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_options = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213454] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_rotate_interval = 1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213592] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_rotate_interval_type = days {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213725] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] log_rotation_type = none {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213825] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.213925] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214069] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214203] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214305] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214434] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] max_dns_nameservers = 5 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214562] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] max_header_line = 16384 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214688] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] max_l3_agents_per_router = 3 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214820] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] max_logfile_count = 30 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.214946] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] max_logfile_size_mb = 200 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215083] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] max_subnet_host_routes = 20 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215218] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] my_ip = 10.180.1.21 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215348] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] my_ipv6 = ::1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215477] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] network_auto_schedule = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215602] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] network_link_prefix = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215733] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215865] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] notify_nova_on_port_data_changes = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.215994] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] notify_nova_on_port_status_changes = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.216137] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] pagination_max_limit = -1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.216265] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] publish_errors = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.216391] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] rate_limit_burst = 0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.216525] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] rate_limit_except_level = CRITICAL {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.216651] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] rate_limit_interval = 0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.216777] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] retry_until_window = 30 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.216906] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] router_distributed = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217042] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] rpc_resources_processing_step = 20 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217169] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] rpc_response_max_timeout = 600 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217300] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] rpc_response_timeout = 60 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217423] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] send_events_interval = 2 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217566] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] service_plugins = ['router'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217698] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] setproctitle = on {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217821] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] shell_completion = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.217950] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] state_path = /opt/stack/data/neutron {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218092] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] syslog_log_facility = LOG_USER {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218221] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] tcp_keepidle = 600 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218354] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] transport_url = **** {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218485] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] use_journal = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218613] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] use_json = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218738] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] use_ssl = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218862] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] use_stderr = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.218994] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] use_syslog = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.219127] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] vlan_qinq = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.219263] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] vlan_transparent = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.219378] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] watch_log_file = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.219503] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] wsgi_default_pool_size = 100 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.219631] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] wsgi_keep_alive = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.219767] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.219901] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] wsgi_server_debug = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.220063] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_concurrency.disable_process_locking = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.220210] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.220351] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.220484] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.220622] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.220758] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.220892] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.221051] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.connection_string = messaging:// {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.221193] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.enabled = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.221334] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.es_doc_type = notification {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.221497] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.es_scroll_size = 10000 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.221644] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.es_scroll_time = 2m {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.221781] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.filter_error_trace = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.221919] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.hmac_keys = **** {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.222066] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.sentinel_service_name = mymaster {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.222211] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.socket_timeout = 0.1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.222350] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.trace_requests = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.222500] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler.trace_sqlalchemy = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.222653] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler_jaeger.process_tags = {} {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.222787] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler_jaeger.service_name_prefix = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.222919] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] profiler_otlp.service_name_prefix = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.223075] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.enforce_new_defaults = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.223346] env[66123]: WARNING oslo_config.cfg [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 526.223494] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.enforce_scope = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.223637] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.policy_default_rule = default {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.223783] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.223920] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.224069] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.224200] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.224328] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.224456] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.224584] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.224718] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.224858] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225006] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] agent.extensions = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225147] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225285] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] service_providers.service_provider = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225439] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.default_quota = -1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225565] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225697] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_floatingip = 50 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225826] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_network = 100 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.225955] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_port = 500 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.226093] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.226220] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_router = 10 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.226348] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_security_group = 10 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.226476] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.226609] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.quota_subnet = 100 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.226738] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] QUOTAS.track_quota_usage = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.226882] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227047] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep.group = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227150] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep.helper_command = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227282] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep.log_daemon_traceback = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227424] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227561] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep.thread_pool_size = 8 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227703] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep.user = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227828] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.227956] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_dhcp_release.group = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228099] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_dhcp_release.helper_command = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228224] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228358] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228483] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228609] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_dhcp_release.user = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228744] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228869] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_ovs_vsctl.group = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.228995] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.229134] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.229289] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.229394] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.229521] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_ovs_vsctl.user = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.229656] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_namespace.capabilities = [21] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.229780] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_namespace.group = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.229906] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_namespace.helper_command = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230046] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230179] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230308] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230435] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_namespace.user = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230573] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_conntrack.capabilities = [12] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230697] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_conntrack.group = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230822] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_conntrack.helper_command = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.230952] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.231095] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.231227] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.231353] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_conntrack.user = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.231520] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_link.capabilities = [12, 21] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.231652] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_link.group = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.231779] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_link.helper_command = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.231912] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_link.log_daemon_traceback = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.232148] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.232289] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_link.thread_pool_size = 8 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.232449] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] privsep_link.user = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.232620] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.232767] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.232907] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.continue_on_failed_promotions = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233051] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.dscp = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233189] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.dscp_inherit = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233329] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.force_mp_to_policy = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233461] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.locking_coordinator_url = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233596] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.log_agent_heartbeats = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233725] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.logging_expire = 1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233860] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.233993] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.234143] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.polling_interval = 240 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.234277] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.234415] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.234557] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.report_interval = 30.0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.234696] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.234833] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.234971] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.235118] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.sync_skew = 60 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.235254] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.synchronization_queue_size = 20 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.235391] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT.use_helper_for_ns_read = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.235592] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] SECURITYGROUP.enable_ipset = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.235821] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] SECURITYGROUP.enable_security_group = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.236066] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.236303] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.236546] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] experimental.ipv6_pd_enabled = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.236802] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.extension_drivers = ['port_security'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.237041] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.external_network_type = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.237227] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.237379] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.overlay_ip_version = 4 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.237526] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.path_mtu = 8950 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.237668] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.physical_network_mtus = {} {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.237813] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.237954] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.238108] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ml2.type_drivers = ['vlan'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.238250] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.238385] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.238520] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.238661] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.238801] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.238938] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.239085] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.239224] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.239360] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.239559] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.239704] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_login_password = **** {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.239848] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.239986] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_login_user = admin {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.240137] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.240277] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.240411] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.240549] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.240687] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.240828] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.240966] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.241115] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.241252] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.241411] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.241565] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.241703] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.241843] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.242039] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.242186] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.242325] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.242500] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.242650] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.auth_section = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.242797] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.auth_type = password {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.242938] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.243080] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.certfile = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.243216] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.collect_timing = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.243355] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.endpoint_type = public {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.243488] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.insecure = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.243616] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.keyfile = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.243775] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.region_name = RegionOne {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.243918] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.split_loggers = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.244058] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] nova.timeout = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.244198] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.auth_section = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.244337] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.auth_type = password {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.244476] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.244606] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.certfile = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.244736] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.collect_timing = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.244872] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.endpoint_type = public {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245007] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.insecure = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245137] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.keyfile = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245264] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.region_name = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245395] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.split_loggers = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245523] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] placement.timeout = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245662] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.auth_section = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245812] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.auth_type = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.245952] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.cafile = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246092] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.certfile = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246225] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.collect_timing = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246351] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.connect_retries = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246478] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.connect_retry_delay = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246612] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.enable_notifications = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246741] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.endpoint_override = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246867] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.insecure = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.246994] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.interface = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.247130] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.keyfile = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.247259] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.max_version = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.247382] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.min_version = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.247506] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.region_name = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.247632] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.retriable_status_codes = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.247754] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.service_name = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.247878] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.service_type = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248017] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.split_loggers = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248146] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.status_code_retries = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248270] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.status_code_retry_delay = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248404] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.timeout = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248521] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.valid_interfaces = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248647] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ironic.version = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248782] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] cli_script.dry_run = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.248935] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.249083] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.249220] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.249352] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.249484] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.249616] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.249750] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.249882] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250016] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250158] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250288] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250425] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250565] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250702] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250837] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.250976] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.251121] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.251253] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.251436] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.251545] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.251684] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.251819] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.251951] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.252094] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.252226] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.252416] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.252525] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.252636] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.252768] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.252900] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.253044] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.ssl = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.253188] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.253325] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.253457] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.253594] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.253749] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.253891] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.254045] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_notifications.driver = [] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.254182] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_notifications.retry = -1 {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.254326] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.254472] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.254587] env[66123]: DEBUG oslo_service.backend._eventlet.service [None req-fc88532e-4f48-40a8-9351-c38b442393a0 None None] ******************************************************************************** {{(pid=66123) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 526.255730] env[66123]: DEBUG neutron.agent.securitygroups_rpc [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Init firewall settings (driver=nsxv3) {{(pid=66123) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 526.257039] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66123) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 526.257279] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] RPC agent_id: nsxm-l-01a.corp.local [ 526.259928] env[66123]: DEBUG dogpile.cache.region [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 526.259928] env[66123]: DEBUG dogpile.lock [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 526.259928] env[66123]: DEBUG dogpile.lock [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 526.259928] env[66123]: DEBUG dogpile.lock [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 526.259928] env[66123]: DEBUG dogpile.cache.region [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 526.260194] env[66123]: DEBUG dogpile.lock [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 526.260194] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 526.297721] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Session token - acquiring [ 526.299274] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.299451] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.299565] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.299987] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.312066] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.587963] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 526.610779] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 526.610969] env[66123]: DEBUG dogpile.cache.region [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Cache value generated in 0.351 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 526.611085] env[66123]: DEBUG dogpile.lock [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 526.611214] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Activating Policy API Provider. [ 526.611486] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Looking for the default Infrastructure Rules. [ 526.676039] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Looking for the Default Layer3 Logged Drop Section. [ 526.689842] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 526.690321] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.690506] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.690609] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.690917] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.691273] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.205876] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.708109] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.210737] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Inventory metadata is going to be refreshed. [ 528.211117] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 528.978686] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.979067] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.979067] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.979326] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.991414] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 528.992310] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.992943] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 529.013507] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.013784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.013784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.014078] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.014205] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.014348] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 529.014463] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 529.014570] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 529.034979] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.035332] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.035332] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.035563] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.035738] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.035891] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 529.055093] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.055380] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.055380] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.055657] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.055802] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.055947] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 529.081973] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.082300] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.082300] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.082630] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.082810] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.082972] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 529.083093] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 529.083197] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 529.104089] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.104388] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.104493] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.104737] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.104864] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.105018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 529.105123] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 529.105229] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 529.126593] env[66123]: DEBUG networking_nsxv3.common.locking [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.127088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.127272] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.127573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.127724] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.127881] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 529.127987] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 529.128101] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Inventory metadata have been refreshed. [ 529.128201] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Dryrun:True. Metadata refresh completed. [ 529.128321] env[66123]: DEBUG oslo_concurrency.lockutils [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Releasing lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.130257] env[66123]: INFO neutron.agent.agent_extensions_manager [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Loaded agent extensions: [] [ 529.130969] env[66123]: DEBUG neutron_lib.callbacks.manager [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66123) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 529.180584] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent RPC Daemon Started! [ 529.180795] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:0 started [ 529.180795] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent out of sync with plugin! [ 534.132026] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 534.132026] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 539.132987] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 539.133412] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 544.076533] env[66123]: INFO networking_nsxv3.common.synchronization [None req-3e7efc73-6368-433f-81bc-e306b5f03f38 demo admin] Enqueued Resource ID: 55b000d0-872c-4747-b9c2-19a46e7ffed6 with Priority: HIGHEST for action security_group_rules [ 544.077175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b000d0-872c-4747-b9c2-19a46e7ffed6 with Priority: HIGHEST for action security_group_rules [ 544.077532] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b000d0-872c-4747-b9c2-19a46e7ffed6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.077687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b000d0-872c-4747-b9c2-19a46e7ffed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.077788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b000d0-872c-4747-b9c2-19a46e7ffed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.078180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b000d0-872c-4747-b9c2-19a46e7ffed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.078306] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b000d0-872c-4747-b9c2-19a46e7ffed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.598868] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.599113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.599113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.599305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.599398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.599514] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b000d0-872c-4747-b9c2-19a46e7ffed6 already deleted. [ 544.599597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b000d0-872c-4747-b9c2-19a46e7ffed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.078895] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 549.079375] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 554.079983] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 554.080235] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.133760] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.134337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.134337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.134468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.134726] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.637803] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.140257] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.642835] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 558.643119] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 559.081194] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 559.081194] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 559.384493] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.384938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.384938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.384938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.395651] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 559.396519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.397383] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 559.415063] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.415274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.415274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.415453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.415545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.415649] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 559.415723] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.415794] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 559.435286] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.435516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.435516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.435681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.435812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.435925] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 559.454287] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.454500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.454500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.454678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.454786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.454893] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 559.474306] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.474522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.474522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.474701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.474802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.474919] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 559.474990] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.475070] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 559.494286] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.494498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.494498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.494685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.494793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.494876] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 559.494941] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.495018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 559.513597] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.513793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.513793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.513965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.514112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.514230] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 559.514302] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.514367] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 559.514425] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 559.514500] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 559.514556] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 559.514616] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 559.514905] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 559.514966] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 559.515047] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 559.534850] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.535085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.535085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.535286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.535391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.535501] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 559.553607] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.553844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.553844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.553999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.554139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.567053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.082745] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 564.083126] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 569.084617] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 569.084893] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.651337] env[66123]: INFO networking_nsxv3.common.synchronization [None req-a2c51e77-4f8a-4b26-be8f-06a12689d19c None None] Enqueued Resource ID: 70f91513-7ca3-41f4-b804-dfeef6b11bb9 with Priority: HIGHEST for action port [ 573.651934] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f91513-7ca3-41f4-b804-dfeef6b11bb9 with Priority: HIGHEST for action port [ 573.652895] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-70f91513-7ca3-41f4-b804-dfeef6b11bb9 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.652895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70f91513-7ca3-41f4-b804-dfeef6b11bb9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.652895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70f91513-7ca3-41f4-b804-dfeef6b11bb9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.652895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70f91513-7ca3-41f4-b804-dfeef6b11bb9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.652895] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70f91513-7ca3-41f4-b804-dfeef6b11bb9',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.159365] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70f91513-7ca3-41f4-b804-dfeef6b11bb9 [ 574.159365] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.159365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.159365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.159365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.159365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.159365] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70f91513-7ca3-41f4-b804-dfeef6b11bb9 already deleted. [ 574.159365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70f91513-7ca3-41f4-b804-dfeef6b11bb9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.615357] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d9dfa9d9-5b76-4760-b15a-8a1240e73c6e None None] Enqueued Resource ID: 850bb9c3-bdb7-4f67-88c9-56a402c845d0 with Priority: HIGHEST for action port [ 575.615860] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850bb9c3-bdb7-4f67-88c9-56a402c845d0 with Priority: HIGHEST for action port [ 575.616349] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-850bb9c3-bdb7-4f67-88c9-56a402c845d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.616349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-850bb9c3-bdb7-4f67-88c9-56a402c845d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.616349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-850bb9c3-bdb7-4f67-88c9-56a402c845d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.620025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-850bb9c3-bdb7-4f67-88c9-56a402c845d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.620025] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('850bb9c3-bdb7-4f67-88c9-56a402c845d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.120352] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 850bb9c3-bdb7-4f67-88c9-56a402c845d0 [ 576.120352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.120352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.120352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.120352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.120352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.120352] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:850bb9c3-bdb7-4f67-88c9-56a402c845d0 already deleted. [ 576.120352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-850bb9c3-bdb7-4f67-88c9-56a402c845d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.813747] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1c7e8766-ada9-4f0f-abdc-d87a4f7e4003 None None] Enqueued Resource ID: a3580ac8-e33b-4d31-8c3a-ace3fe141e0b with Priority: HIGHEST for action port [ 576.814021] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3580ac8-e33b-4d31-8c3a-ace3fe141e0b with Priority: HIGHEST for action port [ 576.814788] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3580ac8-e33b-4d31-8c3a-ace3fe141e0b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.814917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3580ac8-e33b-4d31-8c3a-ace3fe141e0b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.814987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3580ac8-e33b-4d31-8c3a-ace3fe141e0b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.815729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3580ac8-e33b-4d31-8c3a-ace3fe141e0b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.815729] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3580ac8-e33b-4d31-8c3a-ace3fe141e0b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.313437] env[66123]: INFO networking_nsxv3.common.synchronization [None req-6cc26154-5dab-4ee0-a5ee-e717cf7c3981 None None] Enqueued Resource ID: b8054a6e-0063-4d3c-9258-fb45f36006d3 with Priority: HIGHEST for action port [ 577.313437] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8054a6e-0063-4d3c-9258-fb45f36006d3 with Priority: HIGHEST for action port [ 577.313437] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8054a6e-0063-4d3c-9258-fb45f36006d3 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.313567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8054a6e-0063-4d3c-9258-fb45f36006d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.313567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8054a6e-0063-4d3c-9258-fb45f36006d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.313781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8054a6e-0063-4d3c-9258-fb45f36006d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.313890] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8054a6e-0063-4d3c-9258-fb45f36006d3',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.319430] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3580ac8-e33b-4d31-8c3a-ace3fe141e0b [ 577.319430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.319430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.319430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.319430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.319430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.319430] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3580ac8-e33b-4d31-8c3a-ace3fe141e0b already deleted. [ 577.319430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3580ac8-e33b-4d31-8c3a-ace3fe141e0b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.817303] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8054a6e-0063-4d3c-9258-fb45f36006d3 [ 577.820124] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.820124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.820124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.820124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.820124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.820124] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8054a6e-0063-4d3c-9258-fb45f36006d3 already deleted. [ 577.820124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8054a6e-0063-4d3c-9258-fb45f36006d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.205066] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7ac75699-9bd2-4682-93ea-8ef81d9319be None None] Enqueued Resource ID: 2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6 with Priority: HIGHEST for action port [ 578.205580] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6 with Priority: HIGHEST for action port [ 578.205892] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.207037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.207037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.207353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.207581] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.711506] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6 [ 578.711506] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.711506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.711506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.711506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.711506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.711506] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6 already deleted. [ 578.711506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2477b1ed-a2d7-4735-a9f6-5ce2c89dd2c6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.984170] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7c48e910-6959-493b-9f47-b5360f0a33ff None None] Enqueued Resource ID: acbd43aa-6c3a-4dfb-a9fe-9148246c4bae with Priority: HIGHEST for action port [ 578.985281] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acbd43aa-6c3a-4dfb-a9fe-9148246c4bae with Priority: HIGHEST for action port [ 578.987023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-acbd43aa-6c3a-4dfb-a9fe-9148246c4bae taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.987183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acbd43aa-6c3a-4dfb-a9fe-9148246c4bae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.987256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acbd43aa-6c3a-4dfb-a9fe-9148246c4bae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.987823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acbd43aa-6c3a-4dfb-a9fe-9148246c4bae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.987823] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acbd43aa-6c3a-4dfb-a9fe-9148246c4bae',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.430906] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1eb6b13a-ca48-453c-ba5c-d064722ab85d None None] Enqueued Resource ID: aa046ebf-deeb-47b9-b241-295c8d66e58f with Priority: HIGHEST for action port [ 579.431435] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa046ebf-deeb-47b9-b241-295c8d66e58f with Priority: HIGHEST for action port [ 579.431878] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa046ebf-deeb-47b9-b241-295c8d66e58f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.431878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa046ebf-deeb-47b9-b241-295c8d66e58f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.432083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa046ebf-deeb-47b9-b241-295c8d66e58f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.433309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa046ebf-deeb-47b9-b241-295c8d66e58f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.433437] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa046ebf-deeb-47b9-b241-295c8d66e58f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.490175] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acbd43aa-6c3a-4dfb-a9fe-9148246c4bae [ 579.490175] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.490175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.490175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.490175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.490175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.490175] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acbd43aa-6c3a-4dfb-a9fe-9148246c4bae already deleted. [ 579.490175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acbd43aa-6c3a-4dfb-a9fe-9148246c4bae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.652837] env[66123]: INFO networking_nsxv3.common.synchronization [None req-266a56e2-d5c2-47c0-91f4-5f8588d6af82 None None] Enqueued Resource ID: 06497d7a-59a7-4671-8cda-41216437c322 with Priority: HIGHEST for action port [ 579.653162] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06497d7a-59a7-4671-8cda-41216437c322 with Priority: HIGHEST for action port [ 579.654211] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-06497d7a-59a7-4671-8cda-41216437c322 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.654211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06497d7a-59a7-4671-8cda-41216437c322" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.654211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06497d7a-59a7-4671-8cda-41216437c322" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.656826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06497d7a-59a7-4671-8cda-41216437c322" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.656984] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06497d7a-59a7-4671-8cda-41216437c322',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.938028] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa046ebf-deeb-47b9-b241-295c8d66e58f [ 579.938028] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.938028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.938028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.938028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.938028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.938028] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa046ebf-deeb-47b9-b241-295c8d66e58f already deleted. [ 579.938028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa046ebf-deeb-47b9-b241-295c8d66e58f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.160239] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06497d7a-59a7-4671-8cda-41216437c322 [ 580.160515] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.160667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.160742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.160969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.161071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.161179] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06497d7a-59a7-4671-8cda-41216437c322 already deleted. [ 580.161663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06497d7a-59a7-4671-8cda-41216437c322" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.951265] env[66123]: INFO networking_nsxv3.common.synchronization [None req-9fa6797f-7750-499f-99aa-7c24d9368825 tempest-ServersTestBootFromVolume-261050277 tempest-ServersTestBootFromVolume-261050277-project-member] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_rules [ 580.951807] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_rules [ 580.952162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.952294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.952381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.952594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.952711] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.330312] env[66123]: INFO networking_nsxv3.common.synchronization [None req-2c5eba65-b9da-407c-87f3-c923245de51b None None] Enqueued Resource ID: 3a1be72e-d218-4228-9c07-c68612fab056 with Priority: HIGHEST for action port [ 581.331761] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1be72e-d218-4228-9c07-c68612fab056 with Priority: HIGHEST for action port [ 581.331897] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a1be72e-d218-4228-9c07-c68612fab056 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.332734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a1be72e-d218-4228-9c07-c68612fab056" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.332822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a1be72e-d218-4228-9c07-c68612fab056" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.333124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a1be72e-d218-4228-9c07-c68612fab056" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.333220] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1be72e-d218-4228-9c07-c68612fab056',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.483173] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.483311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.483356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.483609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.483948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.483948] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 already deleted. [ 581.483948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.837956] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a1be72e-d218-4228-9c07-c68612fab056 [ 581.837956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.837956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.837956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.837956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.837956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.837956] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a1be72e-d218-4228-9c07-c68612fab056 already deleted. [ 581.837956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a1be72e-d218-4228-9c07-c68612fab056" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.199499] env[66123]: INFO networking_nsxv3.common.synchronization [None req-00efd20c-6ff8-467c-9b88-f5daab15dbac None None] Enqueued Resource ID: b96b8f42-d3e2-4faa-8f07-c1c3a725ac31 with Priority: HIGHEST for action port [ 582.199499] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96b8f42-d3e2-4faa-8f07-c1c3a725ac31 with Priority: HIGHEST for action port [ 582.200542] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b96b8f42-d3e2-4faa-8f07-c1c3a725ac31 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.200542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b96b8f42-d3e2-4faa-8f07-c1c3a725ac31" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.200542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b96b8f42-d3e2-4faa-8f07-c1c3a725ac31" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.200542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b96b8f42-d3e2-4faa-8f07-c1c3a725ac31" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.200542] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96b8f42-d3e2-4faa-8f07-c1c3a725ac31',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.703608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b96b8f42-d3e2-4faa-8f07-c1c3a725ac31 [ 582.703916] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.703916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.704043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.704338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.704338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.704441] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b96b8f42-d3e2-4faa-8f07-c1c3a725ac31 already deleted. [ 582.704488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b96b8f42-d3e2-4faa-8f07-c1c3a725ac31" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.880763] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e0788a55-2c66-4b1d-aae5-2dcf8f090211 tempest-ServersTestBootFromVolume-261050277 tempest-ServersTestBootFromVolume-261050277-project-member] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_rules [ 582.881312] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_rules [ 582.881608] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.883634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.883720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.883911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.884013] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.408255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.408405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.408475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.408765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.408875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.408982] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 already deleted. [ 583.409308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.444112] env[66123]: INFO networking_nsxv3.common.synchronization [None req-6d9e6dc1-c85c-41ef-8505-a5fd80c55cd3 None None] Enqueued Resource ID: dc79adb0-892b-4af8-baf0-6b40b1780151 with Priority: HIGHEST for action port [ 583.444951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc79adb0-892b-4af8-baf0-6b40b1780151 with Priority: HIGHEST for action port [ 583.448143] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc79adb0-892b-4af8-baf0-6b40b1780151 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.448143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc79adb0-892b-4af8-baf0-6b40b1780151" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.448143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc79adb0-892b-4af8-baf0-6b40b1780151" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.448143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc79adb0-892b-4af8-baf0-6b40b1780151" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.448143] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc79adb0-892b-4af8-baf0-6b40b1780151',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.614961] env[66123]: INFO networking_nsxv3.common.synchronization [None req-be11100d-72ea-4376-b36b-8a695b40a480 None None] Enqueued Resource ID: 2c04f3cf-22b3-47da-8eea-1773bf3e16ad with Priority: HIGHEST for action port [ 583.617253] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c04f3cf-22b3-47da-8eea-1773bf3e16ad with Priority: HIGHEST for action port [ 583.617253] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c04f3cf-22b3-47da-8eea-1773bf3e16ad taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.617253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c04f3cf-22b3-47da-8eea-1773bf3e16ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.617253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c04f3cf-22b3-47da-8eea-1773bf3e16ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.617253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c04f3cf-22b3-47da-8eea-1773bf3e16ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.617253] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c04f3cf-22b3-47da-8eea-1773bf3e16ad',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.948322] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc79adb0-892b-4af8-baf0-6b40b1780151 [ 583.948621] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.948691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.949073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.949073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.949073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.949206] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc79adb0-892b-4af8-baf0-6b40b1780151 already deleted. [ 583.949233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc79adb0-892b-4af8-baf0-6b40b1780151" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.121717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c04f3cf-22b3-47da-8eea-1773bf3e16ad [ 584.121717] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.121717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.121717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.121717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.121717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.121717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c04f3cf-22b3-47da-8eea-1773bf3e16ad already deleted. [ 584.121717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c04f3cf-22b3-47da-8eea-1773bf3e16ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.649028] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d64aa93a-74d6-4e8c-a286-71dc81e5963d None None] Enqueued Resource ID: 3ab38315-2256-4b9b-9da0-4b0b5186ec10 with Priority: HIGHEST for action port [ 584.649643] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab38315-2256-4b9b-9da0-4b0b5186ec10 with Priority: HIGHEST for action port [ 584.650215] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab38315-2256-4b9b-9da0-4b0b5186ec10 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.650429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab38315-2256-4b9b-9da0-4b0b5186ec10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.650536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab38315-2256-4b9b-9da0-4b0b5186ec10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.650834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab38315-2256-4b9b-9da0-4b0b5186ec10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.651605] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab38315-2256-4b9b-9da0-4b0b5186ec10',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.156036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ab38315-2256-4b9b-9da0-4b0b5186ec10 [ 585.156036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.156036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.156036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.156036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.156036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.156036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ab38315-2256-4b9b-9da0-4b0b5186ec10 already deleted. [ 585.156036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab38315-2256-4b9b-9da0-4b0b5186ec10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.707031] env[66123]: INFO networking_nsxv3.common.synchronization [req-7b50d114-768a-4d61-8711-040e5562caac req-a2b6502a-9eed-44aa-9769-fff2a8be4b21 tempest-DeleteServersAdminTestJSON-1729712883 tempest-DeleteServersAdminTestJSON-1729712883-project-member] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 585.707031] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 585.707259] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.707379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.707444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.707684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.707837] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.707942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.708032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.708237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.708342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.708471] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.780601] env[66123]: INFO networking_nsxv3.common.synchronization [None req-cf064009-e920-43e4-ba4f-35a2a909d62f None None] Enqueued Resource ID: 5cb54f26-2181-4dd4-ae31-a46615ebb295 with Priority: HIGHEST for action port [ 585.782307] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb54f26-2181-4dd4-ae31-a46615ebb295 with Priority: HIGHEST for action port [ 585.782886] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cb54f26-2181-4dd4-ae31-a46615ebb295 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.783046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cb54f26-2181-4dd4-ae31-a46615ebb295" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.783447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cb54f26-2181-4dd4-ae31-a46615ebb295" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.784907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cb54f26-2181-4dd4-ae31-a46615ebb295" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.784907] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cb54f26-2181-4dd4-ae31-a46615ebb295',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.219244] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.219244] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.219244] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 already deleted. [ 586.219244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.286791] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cb54f26-2181-4dd4-ae31-a46615ebb295 [ 586.288470] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.288627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.288700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.288929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.289044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.289259] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cb54f26-2181-4dd4-ae31-a46615ebb295 already deleted. [ 586.289334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cb54f26-2181-4dd4-ae31-a46615ebb295" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.741080] env[66123]: INFO networking_nsxv3.common.synchronization [None req-bb4ac844-1e88-4c71-ba55-16e37d0b20e3 None None] Enqueued Resource ID: d1e56667-82fc-4c81-b370-d6f729061932 with Priority: HIGHEST for action port [ 586.741080] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e56667-82fc-4c81-b370-d6f729061932 with Priority: HIGHEST for action port [ 586.741080] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e56667-82fc-4c81-b370-d6f729061932 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.741080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e56667-82fc-4c81-b370-d6f729061932" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.741080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e56667-82fc-4c81-b370-d6f729061932" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.741080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e56667-82fc-4c81-b370-d6f729061932" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.741080] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e56667-82fc-4c81-b370-d6f729061932',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.034774] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.034980] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.035154] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.035458] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.036315] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.036572] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.036955] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.037329] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.037502] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.037904] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.038080] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.038222] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.038353] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.038489] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.038615] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.038767] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.070258] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.070482] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.070686] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.071073] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.072126] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-5b3ed3e4-7366-44bf-afcb-0eb731291672 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.072421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.072647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.072966] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.073235] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b3ed3e4-7366-44bf-afcb-0eb731291672',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.243320] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1e56667-82fc-4c81-b370-d6f729061932 [ 587.243655] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.243731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.243766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.243967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.244081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.244163] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1e56667-82fc-4c81-b370-d6f729061932 already deleted. [ 587.244265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e56667-82fc-4c81-b370-d6f729061932" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.463580] env[66123]: INFO networking_nsxv3.common.synchronization [None req-dc1339c3-1a52-4820-a0c9-4716e30abc39 None None] Enqueued Resource ID: 26e5af44-ff50-4564-8bbf-65e8e4b27602 with Priority: HIGHEST for action port [ 587.464257] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26e5af44-ff50-4564-8bbf-65e8e4b27602 with Priority: HIGHEST for action port [ 587.464692] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-26e5af44-ff50-4564-8bbf-65e8e4b27602 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.464901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26e5af44-ff50-4564-8bbf-65e8e4b27602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.465143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26e5af44-ff50-4564-8bbf-65e8e4b27602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.466644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26e5af44-ff50-4564-8bbf-65e8e4b27602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.466644] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26e5af44-ff50-4564-8bbf-65e8e4b27602',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.578707] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.578707] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.578707] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.578707] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.578707] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.578707] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 5b3ed3e4-7366-44bf-afcb-0eb731291672 not found, creating... [ 587.578707] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.578707] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.579411] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.579411] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.579411] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.579514] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.579595] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.579770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.579770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.579770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.579770] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 5b3ed3e4-7366-44bf-afcb-0eb731291672 is going to be created. [ 587.603381] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.604958] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.605166] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.605528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.605928] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.606082] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.968148] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26e5af44-ff50-4564-8bbf-65e8e4b27602 [ 587.968406] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.968548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.968618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.968855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.968949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.969145] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26e5af44-ff50-4564-8bbf-65e8e4b27602 already deleted. [ 587.969255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26e5af44-ff50-4564-8bbf-65e8e4b27602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.390702] env[66123]: INFO networking_nsxv3.common.synchronization [req-7b50d114-768a-4d61-8711-040e5562caac req-0349e360-0563-4a03-b789-7be474904df1 service nova] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_rules [ 588.390702] env[66123]: INFO networking_nsxv3.common.synchronization [req-7b50d114-768a-4d61-8711-040e5562caac req-0349e360-0563-4a03-b789-7be474904df1 service nova] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 588.390702] env[66123]: INFO networking_nsxv3.common.synchronization [req-7b50d114-768a-4d61-8711-040e5562caac req-0349e360-0563-4a03-b789-7be474904df1 service nova] Enqueued Resource ID: 5b3ed3e4-7366-44bf-afcb-0eb731291672 with Priority: HIGHEST for action port [ 588.390702] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_rules [ 588.390702] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 588.391135] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b3ed3e4-7366-44bf-afcb-0eb731291672 with Priority: HIGHEST for action port [ 588.395104] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.395258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.395328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.397792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.397792] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.397792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.397792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.397792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.397792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.397792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.397792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.397792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.398480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.398480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.398480] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.399128] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b3ed3e4-7366-44bf-afcb-0eb731291672 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.399574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.400037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.400037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.400037] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b3ed3e4-7366-44bf-afcb-0eb731291672',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.509544] env[66123]: INFO networking_nsxv3.common.synchronization [None req-79cdf32c-397f-464c-a3b5-1c4525a22de8 None None] Enqueued Resource ID: a12e750f-b275-4cb6-b497-86655fe34ff0 with Priority: HIGHEST for action port [ 588.509544] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12e750f-b275-4cb6-b497-86655fe34ff0 with Priority: HIGHEST for action port [ 588.510973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a12e750f-b275-4cb6-b497-86655fe34ff0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.510973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a12e750f-b275-4cb6-b497-86655fe34ff0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.510973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a12e750f-b275-4cb6-b497-86655fe34ff0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.510973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a12e750f-b275-4cb6-b497-86655fe34ff0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.510973] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a12e750f-b275-4cb6-b497-86655fe34ff0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.902523] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.902751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.909606] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b3ed3e4-7366-44bf-afcb-0eb731291672 with status ACTIVE [ 588.909839] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.910969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.910969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.910969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.911265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.911300] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.911410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.911453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.911617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.911698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.911882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.912143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.912143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.912289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.912406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.912439] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b3ed3e4-7366-44bf-afcb-0eb731291672 is going to be updated. [ 588.913701] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.936349] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.936349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.936733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.936733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.936820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.937298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b3ed3e4-7366-44bf-afcb-0eb731291672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.015123] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a12e750f-b275-4cb6-b497-86655fe34ff0 [ 589.015123] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.015123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.015123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.015123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.015123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.015703] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a12e750f-b275-4cb6-b497-86655fe34ff0 already deleted. [ 589.015703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a12e750f-b275-4cb6-b497-86655fe34ff0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.416884] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.513183] env[66123]: INFO networking_nsxv3.common.synchronization [None req-cf38ba2b-1d6f-4875-ab2a-e1afc2fad052 None None] Enqueued Resource ID: f6cf978b-067a-48d6-9694-32d8071f203b with Priority: HIGHEST for action port [ 589.513826] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6cf978b-067a-48d6-9694-32d8071f203b with Priority: HIGHEST for action port [ 589.514862] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6cf978b-067a-48d6-9694-32d8071f203b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.514862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6cf978b-067a-48d6-9694-32d8071f203b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.514862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6cf978b-067a-48d6-9694-32d8071f203b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.514862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6cf978b-067a-48d6-9694-32d8071f203b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.514862] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6cf978b-067a-48d6-9694-32d8071f203b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.892042] env[66123]: INFO networking_nsxv3.common.synchronization [None req-25aaea6e-2cfd-488a-98d1-0b54b99650c9 None None] Enqueued Resource ID: c4796706-15b9-4173-b754-27a5309ec938 with Priority: HIGHEST for action port [ 589.892680] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4796706-15b9-4173-b754-27a5309ec938 with Priority: HIGHEST for action port [ 589.893094] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4796706-15b9-4173-b754-27a5309ec938 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.893204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4796706-15b9-4173-b754-27a5309ec938" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.893306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4796706-15b9-4173-b754-27a5309ec938" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.893789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4796706-15b9-4173-b754-27a5309ec938" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.893789] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4796706-15b9-4173-b754-27a5309ec938',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.923079] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.923079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.923079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.923079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.923079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.923079] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be created. [ 589.953488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.953634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.953707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.954043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.954116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.967369] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: UNINITIALIZED for 2s [ 590.021466] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6cf978b-067a-48d6-9694-32d8071f203b [ 590.021835] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.021835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.022579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.022579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.022579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.022579] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6cf978b-067a-48d6-9694-32d8071f203b already deleted. [ 590.022579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6cf978b-067a-48d6-9694-32d8071f203b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.397555] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4796706-15b9-4173-b754-27a5309ec938 [ 590.397555] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.397555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.397555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.398560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.398560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.398560] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4796706-15b9-4173-b754-27a5309ec938 already deleted. [ 590.398560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4796706-15b9-4173-b754-27a5309ec938" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.902563] env[66123]: INFO networking_nsxv3.common.synchronization [None req-5d381968-ab4b-4027-bdaf-745285e7e954 None None] Enqueued Resource ID: 9f054ebe-35b5-4771-a463-0099da2ad72e with Priority: HIGHEST for action port [ 590.902563] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f054ebe-35b5-4771-a463-0099da2ad72e with Priority: HIGHEST for action port [ 590.902859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f054ebe-35b5-4771-a463-0099da2ad72e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.902859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f054ebe-35b5-4771-a463-0099da2ad72e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.902952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f054ebe-35b5-4771-a463-0099da2ad72e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.904411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f054ebe-35b5-4771-a463-0099da2ad72e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.904528] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f054ebe-35b5-4771-a463-0099da2ad72e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.968852] env[66123]: INFO networking_nsxv3.common.synchronization [None req-c5604fd9-3251-4fc9-a02d-2c5a163962da tempest-ServerActionsV293TestJSON-94308629 tempest-ServerActionsV293TestJSON-94308629-project-member] Enqueued Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_rules [ 590.968852] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_rules [ 590.968852] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.968852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.968852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.970828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.970929] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.160704] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e9ef255e-ce01-461b-9b74-8dbffb7f99fe tempest-ServerActionsV293TestJSON-94308629 tempest-ServerActionsV293TestJSON-94308629-project-member] Enqueued Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_rules [ 591.161528] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_rules [ 591.161854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.161991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.407384] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f054ebe-35b5-4771-a463-0099da2ad72e [ 591.407687] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.407950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.408097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.408602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.408602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.408793] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f054ebe-35b5-4771-a463-0099da2ad72e already deleted. [ 591.408959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f054ebe-35b5-4771-a463-0099da2ad72e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.495303] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.495417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.495476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.495679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.495808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.496329] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 already deleted. [ 591.496476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.496668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.497259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.497259] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.982404] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: SUCCESS [ 591.982404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.982404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.982404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.983841] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.983841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.983841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.983841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.983841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.983841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.983841] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.021694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.021880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.021921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.022313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.022771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.023015] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 already deleted. [ 592.023103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.487400] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.487561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.487626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.488012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.488012] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.488106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.488161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.488310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.488390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.488472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.488755] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.488755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.488755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.489142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.489142] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.489142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.489298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.489344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.489392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.489460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.489544] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.993389] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34c25001-52de-43e0-a917-8228366264a0: rpc.has_security_group_logging(os_id): False [ 593.013881] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.014114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.014163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.014406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.014484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.015236] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.015236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.015236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.015236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.015236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.015548] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.015548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.015548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.015662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.015662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.015939] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.015939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.015939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.019555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.019665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.019764] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be created. [ 593.093286] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.094182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.094441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.095968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.095968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.112295] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: IN_PROGRESS for 2s [ 593.200606] env[66123]: INFO networking_nsxv3.common.synchronization [None req-14205f82-5121-4266-b32c-8d60332b4961 None None] Enqueued Resource ID: e58c2c63-e5f1-4476-be64-dfa73887e4f4 with Priority: HIGHEST for action port [ 593.201055] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58c2c63-e5f1-4476-be64-dfa73887e4f4 with Priority: HIGHEST for action port [ 593.201497] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e58c2c63-e5f1-4476-be64-dfa73887e4f4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.201497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e58c2c63-e5f1-4476-be64-dfa73887e4f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.201497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e58c2c63-e5f1-4476-be64-dfa73887e4f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.202608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e58c2c63-e5f1-4476-be64-dfa73887e4f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.202767] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58c2c63-e5f1-4476-be64-dfa73887e4f4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.707215] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e58c2c63-e5f1-4476-be64-dfa73887e4f4 [ 593.707215] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.707483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.707483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.707663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.708756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.708756] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e58c2c63-e5f1-4476-be64-dfa73887e4f4 already deleted. [ 593.708756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e58c2c63-e5f1-4476-be64-dfa73887e4f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.239705] env[66123]: INFO networking_nsxv3.common.synchronization [req-2259fb8e-8d2c-4c9e-bc4c-3ceeb2118960 req-fa9dd115-61ac-4800-b1fb-0fd85663fce2 tempest-FloatingIPsAssociationTestJSON-1710505517 tempest-FloatingIPsAssociationTestJSON-1710505517-project-member] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 594.240084] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 594.240310] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.240461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.240622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.242485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.242485] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.242485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.243958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.244207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.244317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.246381] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.749272] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.749478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.749574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.749838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.749956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.750217] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.750340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.750405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.751194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.751304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.751405] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 already deleted. [ 594.751497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.963681] env[66123]: INFO networking_nsxv3.common.synchronization [None req-0e6cb59e-ced7-4b3a-b25d-7d33696b8ccf None None] Enqueued Resource ID: 2c6d5235-f3e3-4d51-bc97-c30ecfcbd431 with Priority: HIGHEST for action port [ 594.964070] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6d5235-f3e3-4d51-bc97-c30ecfcbd431 with Priority: HIGHEST for action port [ 594.965894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c6d5235-f3e3-4d51-bc97-c30ecfcbd431 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.966085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c6d5235-f3e3-4d51-bc97-c30ecfcbd431" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.966209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c6d5235-f3e3-4d51-bc97-c30ecfcbd431" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.966560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c6d5235-f3e3-4d51-bc97-c30ecfcbd431" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.966793] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6d5235-f3e3-4d51-bc97-c30ecfcbd431',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.048852] env[66123]: INFO networking_nsxv3.common.synchronization [None req-5bdf53a9-7114-4f67-9501-76ddaf88f5bc tempest-VolumesAssistedSnapshotsTest-1481914958 tempest-VolumesAssistedSnapshotsTest-1481914958-project-member] Enqueued Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_rules [ 595.051019] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_rules [ 595.051019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.051019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.051019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.051019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.051019] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.083500] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.083733] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.083855] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.084192] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.084872] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.085089] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.085209] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.085499] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.085771] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.086276] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.086432] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.087044] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.087044] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.087044] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.087044] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.087044] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.108525] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.108966] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.109223] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.109407] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.109727] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-1ed97d11-b344-40da-b983-79cc10f0f8f1 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.109894] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.110031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.110335] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.110467] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ed97d11-b344-40da-b983-79cc10f0f8f1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.123496] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: SUCCESS [ 595.123738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.279194] env[66123]: INFO networking_nsxv3.common.synchronization [None req-73c0489b-9102-45b7-a29b-7b1b5581787a None None] Enqueued Resource ID: 061beb7c-8f70-4734-a2f9-165cc9c5706a with Priority: HIGHEST for action port [ 595.279194] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061beb7c-8f70-4734-a2f9-165cc9c5706a with Priority: HIGHEST for action port [ 595.279194] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-061beb7c-8f70-4734-a2f9-165cc9c5706a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.279194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-061beb7c-8f70-4734-a2f9-165cc9c5706a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.279194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-061beb7c-8f70-4734-a2f9-165cc9c5706a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.279194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-061beb7c-8f70-4734-a2f9-165cc9c5706a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.279194] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('061beb7c-8f70-4734-a2f9-165cc9c5706a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.471541] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c6d5235-f3e3-4d51-bc97-c30ecfcbd431 [ 595.471759] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.471874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.471874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.472141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.472226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.472324] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c6d5235-f3e3-4d51-bc97-c30ecfcbd431 already deleted. [ 595.472405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c6d5235-f3e3-4d51-bc97-c30ecfcbd431" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.555045] env[66123]: INFO networking_nsxv3.common.synchronization [None req-cc0bee55-ab48-4ef0-acf3-43ebace5633d None None] Enqueued Resource ID: bc2e8c58-90f8-4b00-9e85-d9fe68045ede with Priority: HIGHEST for action port [ 595.559290] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc2e8c58-90f8-4b00-9e85-d9fe68045ede with Priority: HIGHEST for action port [ 595.559290] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc2e8c58-90f8-4b00-9e85-d9fe68045ede taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.559290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc2e8c58-90f8-4b00-9e85-d9fe68045ede" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.559290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc2e8c58-90f8-4b00-9e85-d9fe68045ede" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.559290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc2e8c58-90f8-4b00-9e85-d9fe68045ede" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.559290] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc2e8c58-90f8-4b00-9e85-d9fe68045ede',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.578482] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.578677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.578768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.578996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.579161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.579253] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 already deleted. [ 595.579393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.613584] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.613584] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.613810] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.614271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.614271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.614388] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 1ed97d11-b344-40da-b983-79cc10f0f8f1 not found, creating... [ 595.614724] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.614953] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.616060] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.616060] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.616060] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.616060] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.616649] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.617447] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.617447] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.617447] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.617718] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 1ed97d11-b344-40da-b983-79cc10f0f8f1 is going to be created. [ 595.640308] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.640643] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.640909] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.641107] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.641383] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.641751] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.783240] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 061beb7c-8f70-4734-a2f9-165cc9c5706a [ 595.783587] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.784565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.784565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.784565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.784565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.784565] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:061beb7c-8f70-4734-a2f9-165cc9c5706a already deleted. [ 595.784565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-061beb7c-8f70-4734-a2f9-165cc9c5706a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.833228] env[66123]: INFO networking_nsxv3.common.synchronization [None req-183c06d5-c9d1-4064-af63-07846368f9d6 tempest-VolumesAssistedSnapshotsTest-1481914958 tempest-VolumesAssistedSnapshotsTest-1481914958-project-member] Enqueued Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_rules [ 595.834277] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_rules [ 595.834277] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.834706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.834752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.835482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.835614] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.063110] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc2e8c58-90f8-4b00-9e85-d9fe68045ede [ 596.063528] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.064501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.064501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.064501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.064501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.064501] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc2e8c58-90f8-4b00-9e85-d9fe68045ede already deleted. [ 596.064501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc2e8c58-90f8-4b00-9e85-d9fe68045ede" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.358374] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.358738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.358738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.358805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.358888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.359123] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 already deleted. [ 596.359123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.870875] env[66123]: INFO networking_nsxv3.common.synchronization [req-2259fb8e-8d2c-4c9e-bc4c-3ceeb2118960 req-dd4bbe69-32cf-4308-b2e0-77f2e9ef08f9 service nova] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_rules [ 596.871592] env[66123]: INFO networking_nsxv3.common.synchronization [req-2259fb8e-8d2c-4c9e-bc4c-3ceeb2118960 req-dd4bbe69-32cf-4308-b2e0-77f2e9ef08f9 service nova] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 596.871592] env[66123]: INFO networking_nsxv3.common.synchronization [req-2259fb8e-8d2c-4c9e-bc4c-3ceeb2118960 req-dd4bbe69-32cf-4308-b2e0-77f2e9ef08f9 service nova] Enqueued Resource ID: 1ed97d11-b344-40da-b983-79cc10f0f8f1 with Priority: HIGHEST for action port [ 596.872256] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_rules [ 596.872396] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 596.872496] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed97d11-b344-40da-b983-79cc10f0f8f1 with Priority: HIGHEST for action port [ 596.872777] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.872891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.872968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.873229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.873317] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.874979] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.875148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.875223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.875420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.875602] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.875710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.875766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.875927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.877242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.877242] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.878339] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ed97d11-b344-40da-b983-79cc10f0f8f1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.878467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.878632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.878862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.879036] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ed97d11-b344-40da-b983-79cc10f0f8f1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.384629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.384936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.384936] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.385849] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ed97d11-b344-40da-b983-79cc10f0f8f1 with status ACTIVE [ 597.386080] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.386171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.386219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.386481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.386621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.386885] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.390083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.391054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.391054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.391054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.391054] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.391054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.391982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.392225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.392371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.392504] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ed97d11-b344-40da-b983-79cc10f0f8f1 is going to be updated. [ 597.419023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.419023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.419023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.419023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.419398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.419398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ed97d11-b344-40da-b983-79cc10f0f8f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.796123] env[66123]: INFO networking_nsxv3.common.synchronization [req-12435b11-66e3-4b01-a7f4-d9a64b47bc38 req-fe874fa9-635c-4e14-ae06-3a7f4a78f008 tempest-MigrationsAdminTest-723267321 tempest-MigrationsAdminTest-723267321-project-member] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 597.796798] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 597.797196] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.797698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.798244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.798953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.799230] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.799292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.799432] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.799615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.799726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.799836] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.894389] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.304682] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.304828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.304933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.305518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.305518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.305518] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.305691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.305691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.305774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.306030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.306030] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 already deleted. [ 598.306030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.308870] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.309047] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.309169] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.309385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.309973] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.310364] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.310447] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.310641] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.310767] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.311685] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.311811] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.311952] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.312086] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.312215] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.312344] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.312449] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.334653] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.335334] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.335334] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.335334] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.335663] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-6f85ebef-9281-46f9-8eaf-d17a3c852f92 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.335663] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.335770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.336228] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.336228] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f85ebef-9281-46f9-8eaf-d17a3c852f92',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.398533] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.398917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.398917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.398997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.399387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.399553] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be created. [ 598.430169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.430299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.430570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.431088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.431301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.443709] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: UNINITIALIZED for 2s [ 598.840215] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.840215] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.840215] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.840215] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.840215] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.840215] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 6f85ebef-9281-46f9-8eaf-d17a3c852f92 not found, creating... [ 598.840215] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.841129] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.841258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.841491] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.841872] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.842285] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.842465] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.843400] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.843400] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.843400] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.843400] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 6f85ebef-9281-46f9-8eaf-d17a3c852f92 is going to be created. [ 598.864435] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.864435] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.864435] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.865718] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.865718] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.865718] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.142882] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7709292f-daf7-4dc0-a269-8471d549b9b0 None None] Enqueued Resource ID: 172dc246-e049-4842-83c8-b88d89abe6f9 with Priority: HIGHEST for action port [ 599.144216] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 172dc246-e049-4842-83c8-b88d89abe6f9 with Priority: HIGHEST for action port [ 599.144216] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-172dc246-e049-4842-83c8-b88d89abe6f9 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.144216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-172dc246-e049-4842-83c8-b88d89abe6f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.144216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-172dc246-e049-4842-83c8-b88d89abe6f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.144451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-172dc246-e049-4842-83c8-b88d89abe6f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.144451] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('172dc246-e049-4842-83c8-b88d89abe6f9',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.538934] env[66123]: INFO networking_nsxv3.common.synchronization [req-12435b11-66e3-4b01-a7f4-d9a64b47bc38 req-99d60ef1-7504-45b4-bacd-05c73e7ef2c3 service nova] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_rules [ 599.539242] env[66123]: INFO networking_nsxv3.common.synchronization [req-12435b11-66e3-4b01-a7f4-d9a64b47bc38 req-99d60ef1-7504-45b4-bacd-05c73e7ef2c3 service nova] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 599.539242] env[66123]: INFO networking_nsxv3.common.synchronization [req-12435b11-66e3-4b01-a7f4-d9a64b47bc38 req-99d60ef1-7504-45b4-bacd-05c73e7ef2c3 service nova] Enqueued Resource ID: 6f85ebef-9281-46f9-8eaf-d17a3c852f92 with Priority: HIGHEST for action port [ 599.540050] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_rules [ 599.540050] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 599.540050] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f85ebef-9281-46f9-8eaf-d17a3c852f92 with Priority: HIGHEST for action port [ 599.540287] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.540408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.540475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.541271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.541271] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.541864] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.542168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.542168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.542257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.542384] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.542476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.542542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.542682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.543337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.543337] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.543847] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f85ebef-9281-46f9-8eaf-d17a3c852f92 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.546828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.546828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.546982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.547174] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f85ebef-9281-46f9-8eaf-d17a3c852f92',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.646358] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 172dc246-e049-4842-83c8-b88d89abe6f9 [ 599.646599] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.646736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.646807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.647039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.647135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.647233] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:172dc246-e049-4842-83c8-b88d89abe6f9 already deleted. [ 599.647315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-172dc246-e049-4842-83c8-b88d89abe6f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.889760] env[66123]: INFO networking_nsxv3.common.synchronization [req-b8431e0e-6836-4fc4-8747-f68119cb8a70 req-0cf2d2d3-61d9-4cd9-a909-54623ebf8a44 tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 599.889760] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 599.889760] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.889760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.889760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.889760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.889760] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.889760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.893028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.893134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.893258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.893308] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.049348] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.050229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.050229] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.050853] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f85ebef-9281-46f9-8eaf-d17a3c852f92 with status ACTIVE [ 600.050853] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.050999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.050999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.051160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.051247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.051427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.052957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.052957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.052957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.052957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.052957] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.053296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.053392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.053626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.053626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.053728] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f85ebef-9281-46f9-8eaf-d17a3c852f92 is going to be updated. [ 600.085364] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.085364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.085364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.085364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.085364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.085705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f85ebef-9281-46f9-8eaf-d17a3c852f92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.359398] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.359398] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.359580] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.359952] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.360299] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.360495] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.360618] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.360912] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.361116] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.361357] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.361511] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.361658] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.361765] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.361909] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.362091] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.362230] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.381884] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.382017] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.382217] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.382581] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.383019] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-5f2ba8b5-ba8e-43d1-837c-44673124f19f taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.383235] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.383403] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.383729] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.383907] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f2ba8b5-ba8e-43d1-837c-44673124f19f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.397251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.397461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.397523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.397777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.397868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.398143] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.398251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.398325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.398521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.398616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.398748] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed already deleted. [ 600.398848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.452447] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: SUCCESS [ 600.452715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.452896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.453210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.453376] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.453496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.453561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.453731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.453813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.453913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.454010] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.556284] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.886905] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.887305] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.887502] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.887818] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.887961] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.888261] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 5f2ba8b5-ba8e-43d1-837c-44673124f19f not found, creating... [ 600.889815] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.889815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.889815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.889815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.889815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.889815] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.889815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.889815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.890216] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.890350] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.890538] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 5f2ba8b5-ba8e-43d1-837c-44673124f19f is going to be created. [ 600.910721] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.910963] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.911077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.912583] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.912583] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.912583] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.957085] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.957085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.957085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.957294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.957474] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.957618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.957660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.957846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.957931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.958038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.958227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.958303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.958364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.958662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.958776] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.958776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.958848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.959482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.959482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.959482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.959482] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.062413] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.064725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.064725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.064725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.064725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.064725] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be created. [ 601.099223] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.099223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.099223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.099223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.099223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.117486] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: UNINITIALIZED for 2s [ 601.200587] env[66123]: INFO networking_nsxv3.common.synchronization [None req-06ffbdb5-d5c5-480d-b642-c5140af95aec None None] Enqueued Resource ID: edb86749-759a-41d9-a27b-af3b016d3c3d with Priority: HIGHEST for action port [ 601.200899] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb86749-759a-41d9-a27b-af3b016d3c3d with Priority: HIGHEST for action port [ 601.201596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-edb86749-759a-41d9-a27b-af3b016d3c3d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.201723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edb86749-759a-41d9-a27b-af3b016d3c3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.201785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edb86749-759a-41d9-a27b-af3b016d3c3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.202128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edb86749-759a-41d9-a27b-af3b016d3c3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.202233] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edb86749-759a-41d9-a27b-af3b016d3c3d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.464303] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb8f4e60-4319-40b5-a8f3-20680c5bcb74: rpc.has_security_group_logging(os_id): False [ 601.482692] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.482829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.482929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.483390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.483492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.483729] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.483826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.483888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.484083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.484428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.484566] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.484662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.484720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.484870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.484943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.485342] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.485450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.485506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.485648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.485724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.485811] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be created. [ 601.545031] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.545031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.545031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.545231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.545394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.569218] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: IN_PROGRESS for 2s [ 601.655862] env[66123]: INFO networking_nsxv3.common.synchronization [req-b8431e0e-6836-4fc4-8747-f68119cb8a70 req-904446e8-255e-4f78-9f38-081880c45b00 service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 601.655862] env[66123]: INFO networking_nsxv3.common.synchronization [req-b8431e0e-6836-4fc4-8747-f68119cb8a70 req-904446e8-255e-4f78-9f38-081880c45b00 service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 601.655862] env[66123]: INFO networking_nsxv3.common.synchronization [req-b8431e0e-6836-4fc4-8747-f68119cb8a70 req-904446e8-255e-4f78-9f38-081880c45b00 service nova] Enqueued Resource ID: 5f2ba8b5-ba8e-43d1-837c-44673124f19f with Priority: HIGHEST for action port [ 601.655862] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 601.655862] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 601.655862] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f2ba8b5-ba8e-43d1-837c-44673124f19f with Priority: HIGHEST for action port [ 601.655862] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.656423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.659117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.659422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.659532] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.660490] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.660641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.660791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.660869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.661749] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.661749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.661749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.661749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.661749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.661749] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.664182] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f2ba8b5-ba8e-43d1-837c-44673124f19f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.665448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.665448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.665448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.665448] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f2ba8b5-ba8e-43d1-837c-44673124f19f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.704711] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edb86749-759a-41d9-a27b-af3b016d3c3d [ 601.704957] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.705115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.705177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.705392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.705481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.706269] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edb86749-759a-41d9-a27b-af3b016d3c3d already deleted. [ 601.706409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edb86749-759a-41d9-a27b-af3b016d3c3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.804087] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e9a7bf64-520f-4927-a22e-5d6f3cb7740f None None] Enqueued Resource ID: 3c371596-2f57-4c5d-8cc5-323732a99460 with Priority: HIGHEST for action port [ 601.804657] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c371596-2f57-4c5d-8cc5-323732a99460 with Priority: HIGHEST for action port [ 601.804960] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c371596-2f57-4c5d-8cc5-323732a99460 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.805098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c371596-2f57-4c5d-8cc5-323732a99460" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.805164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c371596-2f57-4c5d-8cc5-323732a99460" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.805451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c371596-2f57-4c5d-8cc5-323732a99460" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.805534] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c371596-2f57-4c5d-8cc5-323732a99460',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.168040] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.168190] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.168382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.171207] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f2ba8b5-ba8e-43d1-837c-44673124f19f with status ACTIVE [ 602.171429] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.171598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.171702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.171990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.172178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.172421] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.172596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.172721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.172951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.173289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.173367] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.173503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.173634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.173824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.173945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.174084] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f2ba8b5-ba8e-43d1-837c-44673124f19f is going to be updated. [ 602.203183] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.203183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.203183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.203183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.203183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.203835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f2ba8b5-ba8e-43d1-837c-44673124f19f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.308707] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c371596-2f57-4c5d-8cc5-323732a99460 [ 602.308943] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.309104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.309171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.309390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.309882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.309882] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c371596-2f57-4c5d-8cc5-323732a99460 already deleted. [ 602.309882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c371596-2f57-4c5d-8cc5-323732a99460" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.450322] env[66123]: INFO networking_nsxv3.common.synchronization [req-a6405cc9-3142-43c7-af64-54d95ecb83d7 req-fc145421-a9cd-4c84-937d-9b34335ac136 tempest-TenantUsagesTestJSON-1842817518 tempest-TenantUsagesTestJSON-1842817518-project-member] Enqueued Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_members [ 602.450934] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_members [ 602.451420] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.451733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.451733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.451913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.452181] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.452300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.452363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.452540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.452635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.452740] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.672388] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.834450] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.834659] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.834781] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.835059] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.835320] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.835491] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.835586] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.835793] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.835932] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.836141] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.836258] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.836360] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.836461] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.836564] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.836679] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.836856] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.855170] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.855383] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.855551] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.855729] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.856062] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-684b3c3c-e810-4708-b70d-9c7aded9f42d taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.856251] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.856363] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.856693] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.856823] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('684b3c3c-e810-4708-b70d-9c7aded9f42d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.955139] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.955557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.955557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.955672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.955714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.955897] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.955988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.956102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.956211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.957488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.957488] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d already deleted. [ 602.957596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.128150] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: SUCCESS [ 603.128289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.128460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.128681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.129478] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.129478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.129478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.129478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.129478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.129478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.129478] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.176083] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.176729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.176729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.176729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.176729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.177178] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be created. [ 603.201610] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.201852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.201852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.202151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.202245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.214539] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: UNINITIALIZED for 2s [ 603.363276] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.363276] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.363276] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.364611] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.364996] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.365197] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 684b3c3c-e810-4708-b70d-9c7aded9f42d not found, creating... [ 603.369563] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.369654] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.369828] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.370398] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.370602] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.372753] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.372753] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.372753] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.372753] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.372753] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.372753] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 684b3c3c-e810-4708-b70d-9c7aded9f42d is going to be created. [ 603.399910] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.400138] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.400264] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.400535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.400799] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.401052] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.584264] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: SUCCESS [ 603.584478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.633344] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.633539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.633633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.633893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.634133] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.634252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.634347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.634644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.634734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.634857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.635060] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.635173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.635305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.635437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.635588] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.635705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.635769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.635922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.636050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.636157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.636320] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.833614] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-29058862-a724-425b-b23e-132a82b14f67 tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 603.833900] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 603.834215] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.834318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.834384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.834628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.834814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.834886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.835099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.835322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.835407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.835501] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.051283] env[66123]: INFO networking_nsxv3.common.synchronization [None req-49e56c7f-d644-44f0-9f99-29553228502a None None] Enqueued Resource ID: e9fb21c4-301e-45a7-a10f-23f24bae4a19 with Priority: HIGHEST for action port [ 604.051283] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9fb21c4-301e-45a7-a10f-23f24bae4a19 with Priority: HIGHEST for action port [ 604.051283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9fb21c4-301e-45a7-a10f-23f24bae4a19 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.051283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9fb21c4-301e-45a7-a10f-23f24bae4a19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.051283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9fb21c4-301e-45a7-a10f-23f24bae4a19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.051729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9fb21c4-301e-45a7-a10f-23f24bae4a19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.051978] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9fb21c4-301e-45a7-a10f-23f24bae4a19',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.142169] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56: rpc.has_security_group_logging(os_id): False [ 604.147772] env[66123]: INFO networking_nsxv3.common.synchronization [req-a6405cc9-3142-43c7-af64-54d95ecb83d7 req-981c9c4d-4d06-41c6-aab0-1ce9355c6374 service nova] Enqueued Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_rules [ 604.147953] env[66123]: INFO networking_nsxv3.common.synchronization [req-a6405cc9-3142-43c7-af64-54d95ecb83d7 req-981c9c4d-4d06-41c6-aab0-1ce9355c6374 service nova] Enqueued Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_members [ 604.148100] env[66123]: INFO networking_nsxv3.common.synchronization [req-a6405cc9-3142-43c7-af64-54d95ecb83d7 req-981c9c4d-4d06-41c6-aab0-1ce9355c6374 service nova] Enqueued Resource ID: 684b3c3c-e810-4708-b70d-9c7aded9f42d with Priority: HIGHEST for action port [ 604.148333] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_rules [ 604.148481] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_members [ 604.148561] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 684b3c3c-e810-4708-b70d-9c7aded9f42d with Priority: HIGHEST for action port [ 604.152784] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.152952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.153148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.153392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.153538] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.154771] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.154896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.154963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.155223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.155316] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.155465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.155465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.155620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.155700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.155797] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.156950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-684b3c3c-e810-4708-b70d-9c7aded9f42d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.157069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.157148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.157296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.157373] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('684b3c3c-e810-4708-b70d-9c7aded9f42d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.165136] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.165136] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.165136] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.165136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.165780] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.165780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.165780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.165780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.165780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.165780] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be created. [ 604.237027] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.237027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.237027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.237027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.237027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.252216] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: IN_PROGRESS for 2s [ 604.338371] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.338578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.338621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.338873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.338969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.339207] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.339317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.339382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.339553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.339644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.339823] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 already deleted. [ 604.339823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.468894] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-a8a9b8b8-8df7-4f95-ad24-81bb45c7087e tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 604.469435] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 604.469733] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.469856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.469989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.470239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.470385] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.470483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.470542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.470686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.470769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.470858] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.554430] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9fb21c4-301e-45a7-a10f-23f24bae4a19 [ 604.555427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.555427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.555427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.555427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.555427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.555427] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9fb21c4-301e-45a7-a10f-23f24bae4a19 already deleted. [ 604.555735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9fb21c4-301e-45a7-a10f-23f24bae4a19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.661391] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.662605] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.662739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.662865] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 684b3c3c-e810-4708-b70d-9c7aded9f42d with status ACTIVE [ 604.663046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.663196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.663446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.663921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.664591] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.664591] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.664591] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.664591] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.664804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.664804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.665060] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.669800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.669800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.669800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.669800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.669800] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 684b3c3c-e810-4708-b70d-9c7aded9f42d is going to be updated. [ 604.694696] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.694926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.695016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.695276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.695418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.695581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-684b3c3c-e810-4708-b70d-9c7aded9f42d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.965812] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-63bc6c53-1e51-472b-be4e-3f860ae063d3 tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 604.966359] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 604.966663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.966764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.972883] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.973099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.973136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.973406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.973922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.973922] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.973922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.973922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.974136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.974136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.974190] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 already deleted. [ 604.974284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.974725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.975022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.975661] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.975811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.975864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.976912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.976912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.976912] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.169149] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.229029] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.229029] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.229029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.229029] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.375704] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.376076] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.376076] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.376782] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.376982] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.377166] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.377308] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.377560] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.377703] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.377905] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.378024] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.378221] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.378221] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.378359] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.378423] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.378545] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.398119] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.398306] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.398428] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.398571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.398887] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-cedbf7dc-283a-4f76-bf75-0870264dd1e5 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.399071] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.399188] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.399568] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.399703] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cedbf7dc-283a-4f76-bf75-0870264dd1e5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.478577] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.478730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.478784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.479039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.479126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.479325] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.479424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.479485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.479697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.479784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.479784] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 already deleted. [ 605.480323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.671595] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.671791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.671875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.672186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.672308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.672562] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d is going to be created. [ 605.698698] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.698902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.698902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.700143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.700143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.709681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d in Status: UNINITIALIZED for 2s [ 605.732516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.732762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.732821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.733039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.733254] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.733368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.733430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.733607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.733715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.733805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.733958] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.734064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.734128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.734290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.734435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.734545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.734768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.734768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.734870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.734930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.735023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.902323] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.902585] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.902708] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.902996] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.903202] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.903347] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port cedbf7dc-283a-4f76-bf75-0870264dd1e5 not found, creating... [ 605.903621] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.903776] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.903889] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.904118] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.904254] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.904555] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.904693] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.904891] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.905121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.905269] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.905413] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: cedbf7dc-283a-4f76-bf75-0870264dd1e5 is going to be created. [ 605.927862] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.928104] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.928227] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.928507] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.928783] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.929017] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.237866] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3b19fe3-562d-4163-b8e0-7d5f0c6475ed: rpc.has_security_group_logging(os_id): False [ 606.259119] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.259442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.259442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.259637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.259739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.260021] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.260136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.260207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.260499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.260600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.260822] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.260930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.263404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.263404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.263404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.263404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.263404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.263404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.263404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.263404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.263404] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be created. [ 606.281057] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: SUCCESS [ 606.281953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.334013] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ce21b8e-be0a-453f-be02-e6d4c04bc77f req-c96215fe-be71-45be-9310-5bc6d431ec68 tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 606.334576] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 606.334886] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.335024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.335089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.335295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.335453] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.335552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.335614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.335763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.335850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.335943] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.338354] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.338479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.338552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.338715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.338887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.369732] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 606.707709] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-aa83d233-b06e-44b3-8136-5e63297969bb service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 606.708573] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-aa83d233-b06e-44b3-8136-5e63297969bb service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 606.708573] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-aa83d233-b06e-44b3-8136-5e63297969bb service nova] Enqueued Resource ID: cedbf7dc-283a-4f76-bf75-0870264dd1e5 with Priority: HIGHEST for action port [ 606.709342] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 606.709342] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 606.709342] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cedbf7dc-283a-4f76-bf75-0870264dd1e5 with Priority: HIGHEST for action port [ 606.709342] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.709342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.709750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.709750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.709750] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.710956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.711404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.711470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.711624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.711804] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.711921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.711982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.712446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.712568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.712684] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.717024] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-cedbf7dc-283a-4f76-bf75-0870264dd1e5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.717024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.717024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.717024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.717024] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cedbf7dc-283a-4f76-bf75-0870264dd1e5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.838877] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.218923] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.220110] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.220262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.220424] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cedbf7dc-283a-4f76-bf75-0870264dd1e5 with status ACTIVE [ 607.220591] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.220698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.220761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.220970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.221078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.221252] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.221350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.221411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.221602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.221693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.221881] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.222010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.222371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.222568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.222667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.222827] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cedbf7dc-283a-4f76-bf75-0870264dd1e5 is going to be updated. [ 607.253625] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.254033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.254033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.254399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.254507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.254757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cedbf7dc-283a-4f76-bf75-0870264dd1e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.283556] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.283749] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.283869] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.284158] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.284417] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.284566] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.284676] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.284932] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.285071] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.285240] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.285347] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.285447] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.285549] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.285652] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.285753] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.285880] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.329031] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.329031] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.329031] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.329031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.329031] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-bf9000ae-d650-4f02-8010-2e53dfbf1e19 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.329031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.329031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.329031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.329031] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf9000ae-d650-4f02-8010-2e53dfbf1e19',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.341974] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.720743] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d in Status: SUCCESS [ 607.720743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.720743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.720955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.721143] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.721232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.721280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.721410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.721491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.721583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.721664] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.726039] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.727221] env[66123]: INFO networking_nsxv3.common.synchronization [None req-9b03ab7b-960e-47c0-bc80-f0fe8c4b628c None None] Enqueued Resource ID: ca7ebd2f-38c7-4883-b214-15629cb68593 with Priority: HIGHEST for action port [ 607.728091] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7ebd2f-38c7-4883-b214-15629cb68593 with Priority: HIGHEST for action port [ 607.728679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca7ebd2f-38c7-4883-b214-15629cb68593 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.728795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca7ebd2f-38c7-4883-b214-15629cb68593" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.728858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca7ebd2f-38c7-4883-b214-15629cb68593" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.729093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca7ebd2f-38c7-4883-b214-15629cb68593" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.729166] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7ebd2f-38c7-4883-b214-15629cb68593',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.834234] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.836302] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.836434] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.836728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.836878] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.837050] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port bf9000ae-d650-4f02-8010-2e53dfbf1e19 not found, creating... [ 607.837338] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.837510] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.837618] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.837856] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.837987] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.838279] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.838426] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.838538] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.838739] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.838864] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.838998] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: bf9000ae-d650-4f02-8010-2e53dfbf1e19 is going to be created. [ 607.843849] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.843973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.844056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.844221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.844303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.844394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 607.862045] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.862045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.862045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.863030] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.863030] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.863030] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.875161] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.875295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.875397] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.875563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.875730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.886448] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 608.223972] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.224181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.224266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.224527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.224768] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.224949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.225045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.225292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.225430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.226400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.226400] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.226400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.226400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.226400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.226610] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.226610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.226696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.226868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.226946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.227064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.227169] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.231013] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca7ebd2f-38c7-4883-b214-15629cb68593 [ 608.231218] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.231343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.231420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.231607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.231703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.231794] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca7ebd2f-38c7-4883-b214-15629cb68593 already deleted. [ 608.231876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca7ebd2f-38c7-4883-b214-15629cb68593" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.232213] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.232347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.232389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.232546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.232639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.232724] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be created. [ 608.261339] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.261623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.261623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.261798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.261961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.272261] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: UNINITIALIZED for 2s [ 608.392926] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 608.392926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.577243] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ce21b8e-be0a-453f-be02-e6d4c04bc77f req-8d30c6ff-ff23-4edb-bfdb-7b66c9a75061 service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 608.577243] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ce21b8e-be0a-453f-be02-e6d4c04bc77f req-8d30c6ff-ff23-4edb-bfdb-7b66c9a75061 service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 608.577243] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ce21b8e-be0a-453f-be02-e6d4c04bc77f req-8d30c6ff-ff23-4edb-bfdb-7b66c9a75061 service nova] Enqueued Resource ID: bf9000ae-d650-4f02-8010-2e53dfbf1e19 with Priority: HIGHEST for action port [ 608.579559] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 608.579711] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 608.579811] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9000ae-d650-4f02-8010-2e53dfbf1e19 with Priority: HIGHEST for action port [ 608.580123] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.580277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.581235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.581457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.581546] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.583020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.585416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.588974] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf9000ae-d650-4f02-8010-2e53dfbf1e19 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.588974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.588974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.588974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.588974] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf9000ae-d650-4f02-8010-2e53dfbf1e19',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.679049] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d96d3ccb-3666-4f5c-8004-27106409cb30 None None] Enqueued Resource ID: ac928e51-13e7-4067-b057-9b88826f647c with Priority: HIGHEST for action port [ 608.679611] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac928e51-13e7-4067-b057-9b88826f647c with Priority: HIGHEST for action port [ 608.679923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac928e51-13e7-4067-b057-9b88826f647c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.680081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac928e51-13e7-4067-b057-9b88826f647c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.680158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac928e51-13e7-4067-b057-9b88826f647c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.680467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac928e51-13e7-4067-b057-9b88826f647c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.680559] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac928e51-13e7-4067-b057-9b88826f647c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.731480] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d: rpc.has_security_group_logging(os_id): False [ 608.750198] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.750387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.750387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.750601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.750718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.750929] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.751058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.751143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.751299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.751384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.751600] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.751712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.751781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.751930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.752042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.752297] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.752403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.752474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.752626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.752707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.752797] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d is going to be created. [ 608.815946] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.816120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.816187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.816405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.816584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.827973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d in Status: IN_PROGRESS for 2s [ 608.871273] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.871273] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-994" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.871273] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-994" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.871273] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-994" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.871461] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.871577] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.871687] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.871899] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.872046] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.872275] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.872383] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.872487] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.872626] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.872738] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.872839] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.872965] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.893239] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.893475] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.893614] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.893779] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-994" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.894105] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-1966c806-ae85-4d94-aa8d-a5f78c87855d taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.894274] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.894386] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.894748] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.894895] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1966c806-ae85-4d94-aa8d-a5f78c87855d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.090462] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf9000ae-d650-4f02-8010-2e53dfbf1e19 with status ACTIVE [ 609.090985] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.090985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.090985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.091195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.091291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.091511] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.091617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.091680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.091838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.091916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.093096] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.093096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.093096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.093096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.093096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.093096] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf9000ae-d650-4f02-8010-2e53dfbf1e19 is going to be updated. [ 609.094349] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.094449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.117308] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.117308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.117308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.117308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.117308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.117308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf9000ae-d650-4f02-8010-2e53dfbf1e19" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.184018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac928e51-13e7-4067-b057-9b88826f647c [ 609.184018] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.184018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.184018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.184018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.184018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.184018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac928e51-13e7-4067-b057-9b88826f647c already deleted. [ 609.184018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac928e51-13e7-4067-b057-9b88826f647c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.397271] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.397741] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.397741] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.398457] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.398457] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.398457] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 1966c806-ae85-4d94-aa8d-a5f78c87855d not found, creating... [ 609.398457] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.398635] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.398828] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.399033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.399110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.399384] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.399801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.399801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.399922] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.400224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.400801] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 1966c806-ae85-4d94-aa8d-a5f78c87855d is going to be created. [ 609.421903] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.422278] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.422608] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.423064] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.424594] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.424594] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.899262] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 609.899510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.899690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.899984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.900643] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.900643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.900643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.900643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.900643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.900643] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.130639] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-ef050627-1eea-4543-838a-310ab136012e service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 610.130997] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-ef050627-1eea-4543-838a-310ab136012e service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 610.131411] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-ef050627-1eea-4543-838a-310ab136012e service nova] Enqueued Resource ID: 1966c806-ae85-4d94-aa8d-a5f78c87855d with Priority: HIGHEST for action port [ 610.132294] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 610.132294] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 610.132426] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966c806-ae85-4d94-aa8d-a5f78c87855d with Priority: HIGHEST for action port [ 610.132611] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.132718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.133071] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.133205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.135603] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1966c806-ae85-4d94-aa8d-a5f78c87855d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.135603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.135603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.135603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.135603] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1966c806-ae85-4d94-aa8d-a5f78c87855d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.284381] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.287023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.287023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.287023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.288222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.288539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.288911] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.289173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.289391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.289642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.289821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.290012] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.397783] env[66123]: INFO networking_nsxv3.common.synchronization [req-712469d7-43e9-4e6e-86d6-b6b10a2697ce req-59664183-ad2c-43ec-80e0-07ac11b66adc tempest-DeleteServersAdminTestJSON-64941121 tempest-DeleteServersAdminTestJSON-64941121-project-admin] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 610.397783] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 610.397783] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.397783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.397783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.397783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.397783] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.397783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.398436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.398436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.398436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.398436] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.403842] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.638274] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1966c806-ae85-4d94-aa8d-a5f78c87855d with status ACTIVE [ 610.638274] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.638274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.638444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.638618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.638618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.638777] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.639160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.639160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.639160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.639270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.639579] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.639579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.639579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.639770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.639770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.639864] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1966c806-ae85-4d94-aa8d-a5f78c87855d is going to be updated. [ 610.665325] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.665325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.665325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.665549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.665549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.665723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1966c806-ae85-4d94-aa8d-a5f78c87855d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.755266] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ad0113bb-a6bc-4f47-878f-5cbe7f785c7a None None] Enqueued Resource ID: 6fd57671-3293-4d50-a5eb-63257d339f4d with Priority: HIGHEST for action port [ 610.755266] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd57671-3293-4d50-a5eb-63257d339f4d with Priority: HIGHEST for action port [ 610.755266] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fd57671-3293-4d50-a5eb-63257d339f4d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.755266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fd57671-3293-4d50-a5eb-63257d339f4d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.755266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fd57671-3293-4d50-a5eb-63257d339f4d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.755266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fd57671-3293-4d50-a5eb-63257d339f4d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.755266] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fd57671-3293-4d50-a5eb-63257d339f4d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.784256] env[66123]: INFO networking_nsxv3.common.synchronization [req-847e621e-1bd3-43f5-8429-e9276b729092 req-e1196bac-8101-4e90-9c7d-b119c4278b83 tempest-VolumesAssistedSnapshotsTest-1481914958 tempest-VolumesAssistedSnapshotsTest-1481914958-project-member] Enqueued Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_members [ 610.784256] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_members [ 610.785393] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.786409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.786409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.786409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.786716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.789826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.789908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.790121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.790209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.790309] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.792289] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.792410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.794315] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.848413] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d in Status: SUCCESS [ 610.848653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.865420] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d24c5469-e949-4370-a574-0a838e675c55 None None] Enqueued Resource ID: 2300087e-b716-4620-b9ca-05c53513e4c8 with Priority: HIGHEST for action port [ 610.866372] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2300087e-b716-4620-b9ca-05c53513e4c8 with Priority: HIGHEST for action port [ 610.866522] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2300087e-b716-4620-b9ca-05c53513e4c8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.866711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2300087e-b716-4620-b9ca-05c53513e4c8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.866711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2300087e-b716-4620-b9ca-05c53513e4c8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.867423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2300087e-b716-4620-b9ca-05c53513e4c8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.867423] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2300087e-b716-4620-b9ca-05c53513e4c8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.904625] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.904859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.904998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.905226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.905330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.905605] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.906209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.906209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.906209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.906209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.906209] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be updated. [ 610.908431] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.940704] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.940704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.940704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.941103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.941103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.951277] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: IN_PROGRESS for 2s [ 611.078309] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.078309] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.078309] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.078309] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.078309] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.082524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.082524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.082524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.082524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.082524] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.082524] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.082524] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.082524] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.082524] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.082524] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.082524] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.106434] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.106738] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.106958] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.107294] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.107761] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-82b11d4c-e410-48d8-900c-59ffb6a5f15f taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.107949] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.108083] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.108399] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.108529] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b11d4c-e410-48d8-900c-59ffb6a5f15f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.257776] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fd57671-3293-4d50-a5eb-63257d339f4d [ 611.257992] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.258157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.258210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.258417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.258512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.258609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fd57671-3293-4d50-a5eb-63257d339f4d already deleted. [ 611.258740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fd57671-3293-4d50-a5eb-63257d339f4d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.266117] env[66123]: INFO networking_nsxv3.common.synchronization [req-c897592c-52f8-4604-893d-a24610f4097a req-294fb13e-8427-4ee4-b3f8-c306a01c97b8 tempest-ServerDiagnosticsTest-1510758604 tempest-ServerDiagnosticsTest-1510758604-project-member] Enqueued Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_members [ 611.267113] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_members [ 611.267479] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.267644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.267705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.268041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.268770] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.268919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.268950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.269124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.269215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.271034] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.293070] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.293070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.293070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.293322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.293322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.295463] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.295463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.295463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.295463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.295463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.295463] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 already deleted. [ 611.295463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.297081] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.369348] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2300087e-b716-4620-b9ca-05c53513e4c8 [ 611.369570] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.369694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.369856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.370226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.370322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.370425] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2300087e-b716-4620-b9ca-05c53513e4c8 already deleted. [ 611.370506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2300087e-b716-4620-b9ca-05c53513e4c8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.409761] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.410074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.410074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.410896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.410896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.410896] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 611.443259] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.443519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.443519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.443745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.443969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.455024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 611.612635] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.612896] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.612983] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.613345] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.613468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.613614] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 82b11d4c-e410-48d8-900c-59ffb6a5f15f not found, creating... [ 611.613862] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.614025] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.614716] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.614716] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.614716] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.615025] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.615025] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.615201] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.615482] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.615482] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.615642] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 82b11d4c-e410-48d8-900c-59ffb6a5f15f is going to be created. [ 611.653839] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.653839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.653839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.653839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.653839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.653839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.774032] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.776064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.776064] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b already deleted. [ 611.776064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.800560] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.800560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.800560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.800560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.800560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.800560] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 611.844146] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.844146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.844146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.844146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.844544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.848230] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.848408] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.848529] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.848859] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.849386] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.849575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.849664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.849876] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.850078] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.850305] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.850413] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.850515] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.850615] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.850826] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.850826] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.850941] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.858337] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 611.871777] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.871931] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.872072] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.872309] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.872619] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-fc220d93-c285-443f-8c52-59a095ff6597 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.872788] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.872901] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.873261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.873382] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc220d93-c285-443f-8c52-59a095ff6597',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.347945] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-cfc3ba4a-c61c-4177-a072-dee46b0eb856 service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 612.348143] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-cfc3ba4a-c61c-4177-a072-dee46b0eb856 service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 612.348281] env[66123]: INFO networking_nsxv3.common.synchronization [req-eef64a38-a2ed-4070-96b1-ee09ad4d34e7 req-cfc3ba4a-c61c-4177-a072-dee46b0eb856 service nova] Enqueued Resource ID: 82b11d4c-e410-48d8-900c-59ffb6a5f15f with Priority: HIGHEST for action port [ 612.348511] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 612.348641] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 612.348738] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82b11d4c-e410-48d8-900c-59ffb6a5f15f with Priority: HIGHEST for action port [ 612.350959] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.351110] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.351330] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.351472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.351655] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-82b11d4c-e410-48d8-900c-59ffb6a5f15f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.351762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.351825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.352032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.352158] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b11d4c-e410-48d8-900c-59ffb6a5f15f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.376303] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.376582] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.376729] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.377135] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.377380] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.377577] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port fc220d93-c285-443f-8c52-59a095ff6597 not found, creating... [ 612.377896] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.378296] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.378296] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.378578] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.378629] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.379014] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.379202] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.379351] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.379648] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.379842] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.380029] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: fc220d93-c285-443f-8c52-59a095ff6597 is going to be created. [ 612.402422] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.402693] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.402794] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.403094] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.403373] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.403610] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.857414] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82b11d4c-e410-48d8-900c-59ffb6a5f15f with status ACTIVE [ 612.857685] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.857784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.857852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.858320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.858320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.858513] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.858591] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.858643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.858798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.858880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.859098] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.859197] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.859273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.859421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.859502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.859590] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82b11d4c-e410-48d8-900c-59ffb6a5f15f is going to be updated. [ 612.885287] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.885502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.885502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.885752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.885865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.886109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82b11d4c-e410-48d8-900c-59ffb6a5f15f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.898044] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.898258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.898388] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.898631] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.898954] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.899120] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.899233] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.899451] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.899586] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.899793] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.899939] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.900031] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.900126] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.900292] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.900432] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.900612] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.935599] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.935851] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.936075] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.936348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.936815] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-dd066a8a-2436-44d2-9a6e-023952a484a8 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.937076] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.937251] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.937769] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.937926] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd066a8a-2436-44d2-9a6e-023952a484a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.963569] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: SUCCESS [ 612.963761] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 deletion is rescheduled due to dependency. [ 612.963882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.125243] env[66123]: INFO networking_nsxv3.common.synchronization [req-847e621e-1bd3-43f5-8429-e9276b729092 req-5f73e623-b5ac-4791-9aa3-65a25466b686 service nova] Enqueued Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_rules [ 613.125243] env[66123]: INFO networking_nsxv3.common.synchronization [req-847e621e-1bd3-43f5-8429-e9276b729092 req-5f73e623-b5ac-4791-9aa3-65a25466b686 service nova] Enqueued Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_members [ 613.125243] env[66123]: INFO networking_nsxv3.common.synchronization [req-847e621e-1bd3-43f5-8429-e9276b729092 req-5f73e623-b5ac-4791-9aa3-65a25466b686 service nova] Enqueued Resource ID: fc220d93-c285-443f-8c52-59a095ff6597 with Priority: HIGHEST for action port [ 613.125243] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_rules [ 613.125243] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_members [ 613.125243] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc220d93-c285-443f-8c52-59a095ff6597 with Priority: HIGHEST for action port [ 613.125612] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.125907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.126075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.126368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.126547] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.127677] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.127962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.128134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.128477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.128732] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.129015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.129166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.129850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.129850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.129850] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.130713] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc220d93-c285-443f-8c52-59a095ff6597 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.130830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.130896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.131062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.131140] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc220d93-c285-443f-8c52-59a095ff6597',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.443023] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.443023] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port dd066a8a-2436-44d2-9a6e-023952a484a8 not found, creating... [ 613.443023] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.443023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.443684] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.443684] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.444266] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.444520] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.444665] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.444808] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: dd066a8a-2436-44d2-9a6e-023952a484a8 is going to be created. [ 613.463838] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 613.464552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.464552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.464552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.464728] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.464825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.464825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.465046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.465139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.465192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.465266] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.467036] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.467233] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.467341] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.467552] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.467758] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.467957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.632843] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.632990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.637402] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.638438] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc220d93-c285-443f-8c52-59a095ff6597 with status ACTIVE [ 613.638664] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.638792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.638860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.639092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.639185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.639395] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.639503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.639567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.639722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.639797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.640263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.640263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.640263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.640419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.640449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.640520] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc220d93-c285-443f-8c52-59a095ff6597 is going to be updated. [ 613.670031] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.670031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.670031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.670031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.670031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.670222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc220d93-c285-443f-8c52-59a095ff6597" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.870820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 613.871140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.871727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.871982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.872235] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.872370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.872437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.872604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.872685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.872771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.872940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.873032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.873086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.873259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.875879] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.876022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.876095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.876262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.876351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.876441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.876531] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.877434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.877602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.877763] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.877870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.877933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.878089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.878172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.878263] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.969935] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.970206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.970302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.970615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.970683] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.970771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.970821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.970959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.971058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.971149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.971298] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.971392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.971443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.971617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.971758] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.971879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.971943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.972048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.972203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.972277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.972382] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.144162] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.167482] env[66123]: INFO networking_nsxv3.common.synchronization [req-c897592c-52f8-4604-893d-a24610f4097a req-d4477d23-e7f5-4b1f-8126-25c838431bcf service nova] Enqueued Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_rules [ 614.167482] env[66123]: INFO networking_nsxv3.common.synchronization [req-c897592c-52f8-4604-893d-a24610f4097a req-d4477d23-e7f5-4b1f-8126-25c838431bcf service nova] Enqueued Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_members [ 614.167482] env[66123]: INFO networking_nsxv3.common.synchronization [req-c897592c-52f8-4604-893d-a24610f4097a req-d4477d23-e7f5-4b1f-8126-25c838431bcf service nova] Enqueued Resource ID: dd066a8a-2436-44d2-9a6e-023952a484a8 with Priority: HIGHEST for action port [ 614.167482] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_rules [ 614.167482] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_members [ 614.167482] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd066a8a-2436-44d2-9a6e-023952a484a8 with Priority: HIGHEST for action port [ 614.167482] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.167482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.167482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.171923] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.171923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.171923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.171923] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.171923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd066a8a-2436-44d2-9a6e-023952a484a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.171923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.171923] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd066a8a-2436-44d2-9a6e-023952a484a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.381560] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2: rpc.has_security_group_logging(os_id): False [ 614.382846] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.403663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.403820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.403918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.404263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.404359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.404551] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.405399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.405399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.405399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.405399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.405399] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.405399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.405399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.405688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.405688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.405688] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.405812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.405848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.405989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.406050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.406162] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be created. [ 614.474817] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3b19fe3-562d-4163-b8e0-7d5f0c6475ed: rpc.has_security_group_logging(os_id): False [ 614.486054] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.486054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.486054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.486054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.486378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.502306] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.502306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.502306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.502606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.502606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.502700] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.502799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.502860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.503022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.503097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.503323] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.503412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.503475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.503621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.503693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.503885] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.504763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.504857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.504986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.505091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.505160] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 614.509170] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 614.624508] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.624735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.624841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.625150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.625415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.648278] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.648522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.649525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.649525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.649525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.649525] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 is going to be created. [ 614.652292] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 614.675588] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd066a8a-2436-44d2-9a6e-023952a484a8 with status ACTIVE [ 614.676132] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.676412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.676744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.678156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.678156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.678156] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.678156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.678156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.678683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.678913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.679388] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.687036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.687036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.687036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.687036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.687036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd066a8a-2436-44d2-9a6e-023952a484a8 is going to be updated. [ 614.687036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.687036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.687036] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.688896] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.689244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.689409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.689694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.689947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.704659] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 in Status: UNINITIALIZED for 2s [ 614.724704] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.725294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.725294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.725533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.725825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.725825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd066a8a-2436-44d2-9a6e-023952a484a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.840611] env[66123]: INFO networking_nsxv3.common.synchronization [req-6befa3eb-82a7-4961-913a-5a1de6515b56 req-1f5381e2-b3c9-464f-9951-8d862fdbda44 tempest-ServersNegativeTestMultiTenantJSON-742028279 tempest-ServersNegativeTestMultiTenantJSON-742028279-project-member] Enqueued Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_members [ 614.841740] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_members [ 614.841740] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.841740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.841740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.842080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.842285] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.842434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.842484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.843225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.843225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.843225] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.886416] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.193964] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.221957] env[66123]: INFO networking_nsxv3.common.synchronization [None req-10aa9c16-15be-4eed-a4f5-1b7a69f35344 None None] Enqueued Resource ID: 11b91958-45be-4c73-8520-c33a91e45d78 with Priority: HIGHEST for action port [ 615.223360] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b91958-45be-4c73-8520-c33a91e45d78 with Priority: HIGHEST for action port [ 615.223734] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-11b91958-45be-4c73-8520-c33a91e45d78 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.224039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11b91958-45be-4c73-8520-c33a91e45d78" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.224197] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11b91958-45be-4c73-8520-c33a91e45d78" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.224516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11b91958-45be-4c73-8520-c33a91e45d78" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.224636] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11b91958-45be-4c73-8520-c33a91e45d78',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.316775] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-331 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.316971] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-331" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.317089] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-331" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.317439] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-331" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.317699] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.317852] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.317965] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.318334] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.318476] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.318679] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.318787] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.318891] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.318995] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.319114] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.319214] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.319342] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.345483] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.345755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.345834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.346118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.346211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.346435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.346547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.346635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.346825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.346908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.346997] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 already deleted. [ 615.347096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.350315] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.350481] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.350610] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.350792] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-331" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.351102] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-3138d832-3227-4928-88f6-935f7fbc929a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.351269] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.351381] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.351688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.351822] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3138d832-3227-4928-88f6-935f7fbc929a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.389529] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.389798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.389798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.390122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.390294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.390359] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 615.423023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.423023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.423023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.423023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.423023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.430197] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 615.698433] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.698639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.698734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.698905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.698970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.699089] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b is going to be created. [ 615.725623] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.725623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.725623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.725844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.725996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.727214] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11b91958-45be-4c73-8520-c33a91e45d78 [ 615.727404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.727519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.727623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.727810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.728028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.728106] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11b91958-45be-4c73-8520-c33a91e45d78 already deleted. [ 615.728180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11b91958-45be-4c73-8520-c33a91e45d78" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.737827] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b in Status: UNINITIALIZED for 2s [ 615.856065] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.856065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.856065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.856065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.856065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.856065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 3138d832-3227-4928-88f6-935f7fbc929a not found, creating... [ 615.856065] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.856065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.856520] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.856520] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.856520] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.856802] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.856907] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.856982] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.857465] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.857673] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.857870] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 3138d832-3227-4928-88f6-935f7fbc929a is going to be created. [ 615.880935] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.881252] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.881414] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.881702] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.881940] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.882248] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.526128] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 616.526128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.526128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.526128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.526128] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.595548] env[66123]: INFO networking_nsxv3.common.synchronization [req-6befa3eb-82a7-4961-913a-5a1de6515b56 req-9200ed8a-7ad4-45f3-adeb-a7efbbe59fe1 service nova] Enqueued Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_rules [ 616.595788] env[66123]: INFO networking_nsxv3.common.synchronization [req-6befa3eb-82a7-4961-913a-5a1de6515b56 req-9200ed8a-7ad4-45f3-adeb-a7efbbe59fe1 service nova] Enqueued Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_members [ 616.596026] env[66123]: INFO networking_nsxv3.common.synchronization [req-6befa3eb-82a7-4961-913a-5a1de6515b56 req-9200ed8a-7ad4-45f3-adeb-a7efbbe59fe1 service nova] Enqueued Resource ID: 3138d832-3227-4928-88f6-935f7fbc929a with Priority: HIGHEST for action port [ 616.596890] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_rules [ 616.597194] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_members [ 616.597283] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3138d832-3227-4928-88f6-935f7fbc929a with Priority: HIGHEST for action port [ 616.597570] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.599361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.599361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.599361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.599361] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.599932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.599932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.600033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.600243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.600379] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.600681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.600681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.600910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.600910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.600995] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.602214] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3138d832-3227-4928-88f6-935f7fbc929a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.602214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.602214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.602214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.602447] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3138d832-3227-4928-88f6-935f7fbc929a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.669639] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 616.670477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.722682] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 in Status: SUCCESS [ 616.722682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.723028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.724510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.724510] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.724510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.724510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.724829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.724977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.725156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.725862] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.028876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.028876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.104453] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.105551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.108081] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3138d832-3227-4928-88f6-935f7fbc929a with status ACTIVE [ 617.108081] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.108081] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.108081] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.108081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.108081] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3138d832-3227-4928-88f6-935f7fbc929a is going to be updated. [ 617.114168] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.139940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.140435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.140633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.140968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.141296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.141606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3138d832-3227-4928-88f6-935f7fbc929a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.228166] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.445286] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.445286] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.445286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.445286] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.621184] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.663342] env[66123]: INFO networking_nsxv3.common.synchronization [None req-8b979527-d1dd-4377-86c0-c1aac1f01e91 None None] Enqueued Resource ID: 1eb03b38-5383-4674-84d2-dda99ea1da8a with Priority: HIGHEST for action port [ 617.663342] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb03b38-5383-4674-84d2-dda99ea1da8a with Priority: HIGHEST for action port [ 617.663342] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1eb03b38-5383-4674-84d2-dda99ea1da8a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.664391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1eb03b38-5383-4674-84d2-dda99ea1da8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.665184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1eb03b38-5383-4674-84d2-dda99ea1da8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.667806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1eb03b38-5383-4674-84d2-dda99ea1da8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.667806] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eb03b38-5383-4674-84d2-dda99ea1da8a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.731423] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for beea9cef-3af0-4483-a93d-bbe9235a8fc4: rpc.has_security_group_logging(os_id): False [ 617.754740] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b in Status: SUCCESS [ 617.758228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.758846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.759107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.759315] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.759471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.759515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.759644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.759730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.759819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.759913] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.762492] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.762492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.763545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.763811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.763963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.765479] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.765653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.765758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.766088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.766226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.766368] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 is going to be created. [ 617.841477] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.842022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.842022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.842022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.842129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.861172] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 in Status: IN_PROGRESS for 2s [ 617.938513] env[66123]: INFO networking_nsxv3.common.synchronization [None req-8e1ce52f-47f9-48e9-ac4f-aa379350d6d1 tempest-ServersWithSpecificFlavorTestJSON-678692171 tempest-ServersWithSpecificFlavorTestJSON-678692171-project-member] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 617.939503] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 617.939872] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.939993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.940074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.940347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.941898] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.949761] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.949761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.949761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.949761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.949987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.950048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.950240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.950327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.950442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.950442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.950596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.950669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.950725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.950862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.951629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.951629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.951629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.951629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.951629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.951629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.951629] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.124961] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.124961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.124961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.125234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.125272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.125367] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 is going to be created. [ 618.152059] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.152059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.152059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.152486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.152486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.165816] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 in Status: UNINITIALIZED for 2s [ 618.169253] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1eb03b38-5383-4674-84d2-dda99ea1da8a [ 618.169591] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.169710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.169710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.169976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.170272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.170394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1eb03b38-5383-4674-84d2-dda99ea1da8a already deleted. [ 618.170460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1eb03b38-5383-4674-84d2-dda99ea1da8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.183826] env[66123]: INFO networking_nsxv3.common.synchronization [None req-2e59eff3-9b2e-4019-ad29-aa05d8f73c1a tempest-ServersWithSpecificFlavorTestJSON-678692171 tempest-ServersWithSpecificFlavorTestJSON-678692171-project-member] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 618.184582] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 618.184964] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.185853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.268679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.268878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.268945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.269186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.273021] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.273021] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.273021] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.273021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.273021] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.454422] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2: rpc.has_security_group_logging(os_id): False [ 618.467141] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.468303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.468303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.468303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.468303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.468303] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3af04420-6b85-4613-8554-92a0065c78dc already deleted. [ 618.468303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.468681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.468681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.468681] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.471688] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.471802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.471867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.472042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.472124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.472331] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.472435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.472489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.472709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.472775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.474053] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.474053] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.474053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.474053] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 618.537376] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.537459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.537530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.537742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.538197] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.559807] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 618.701468] env[66123]: INFO networking_nsxv3.common.synchronization [None req-82c340b3-b44c-4410-9afd-576a27cfbbf3 None None] Enqueued Resource ID: 1bbb08f3-0b4e-4503-aced-c5311741e779 with Priority: HIGHEST for action port [ 618.702150] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb08f3-0b4e-4503-aced-c5311741e779 with Priority: HIGHEST for action port [ 618.702607] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bbb08f3-0b4e-4503-aced-c5311741e779 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.702703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bbb08f3-0b4e-4503-aced-c5311741e779" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.702775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bbb08f3-0b4e-4503-aced-c5311741e779" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.703286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bbb08f3-0b4e-4503-aced-c5311741e779" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.703395] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bbb08f3-0b4e-4503-aced-c5311741e779',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.773793] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7213055e-f608-4dd8-a88d-e239bea6bb7b: rpc.has_security_group_logging(os_id): False [ 618.794756] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.794911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.794998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.795237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.795329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.795902] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.795902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.795902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.795902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.796093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.796339] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.796339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.796339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.796547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.796635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.796839] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.796934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.796988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.797170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.797250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.797337] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b is going to be created. [ 618.853636] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.853871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.853871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.854077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.854256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.865890] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b in Status: IN_PROGRESS for 2s [ 618.994398] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.994660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.994660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.994853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.994947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.995068] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3af04420-6b85-4613-8554-92a0065c78dc already deleted. [ 618.995150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.205966] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bbb08f3-0b4e-4503-aced-c5311741e779 [ 619.206248] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.206408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.206482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.207072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.207072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.207072] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bbb08f3-0b4e-4503-aced-c5311741e779 already deleted. [ 619.207072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bbb08f3-0b4e-4503-aced-c5311741e779" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.321656] env[66123]: INFO networking_nsxv3.common.synchronization [req-81144cc0-5221-455a-b14d-015373b1f892 req-c35b087d-7fed-41b3-8d57-a558b483e978 tempest-ServersTestBootFromVolume-261050277 tempest-ServersTestBootFromVolume-261050277-project-member] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_members [ 619.323586] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_members [ 619.323586] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.323586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.323586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.323586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.323586] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.323586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.323586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.324020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.324020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.324020] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.781149] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.781636] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-249" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.781636] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-249" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.782026] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-249" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.782195] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.782411] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.782522] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.782743] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.782878] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.783099] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.783270] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.783383] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.783493] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.783604] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.783701] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.783825] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.807728] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.807889] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.808255] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.808255] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-249" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.808594] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-7b3213dc-c1ef-419e-93a3-34a959ff655f taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.808814] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.808942] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.809277] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.812097] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b3213dc-c1ef-419e-93a3-34a959ff655f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.826895] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.826895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.826895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.827294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.827361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.827760] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.827895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.828036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.828550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.828550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.828550] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 already deleted. [ 619.828550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.875749] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 in Status: SUCCESS [ 619.875749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.181068] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 in Status: SUCCESS [ 620.181818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.182059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.182342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.182650] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.182753] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.182795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.182973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.183097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.183207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.183307] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.312632] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.313402] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.313642] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.314155] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.314271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.314380] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 7b3213dc-c1ef-419e-93a3-34a959ff655f not found, creating... [ 620.315418] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.315577] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.316666] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.316996] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.317179] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.317595] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.317717] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.318115] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.318115] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.318275] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.318346] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 7b3213dc-c1ef-419e-93a3-34a959ff655f is going to be created. [ 620.344582] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.344824] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.345054] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.345325] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.345610] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.345814] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.581779] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 620.582235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.582746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.582846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.582983] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.687556] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.688251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.688251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.688537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.688767] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.690825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.690946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.691233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.691395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.691483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.691701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.691859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.691912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.692444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.692444] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.692641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.692641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.692738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.692953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.692953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.693057] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.880252] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b in Status: SUCCESS [ 620.880634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.088294] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.088294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.088294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.088613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.088613] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.088613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.088715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.089357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.089357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.089357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.089357] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.166772] env[66123]: INFO networking_nsxv3.common.synchronization [req-81144cc0-5221-455a-b14d-015373b1f892 req-22bda68f-2243-411c-a90c-dc6c1accfff7 service nova] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_rules [ 621.166972] env[66123]: INFO networking_nsxv3.common.synchronization [req-81144cc0-5221-455a-b14d-015373b1f892 req-22bda68f-2243-411c-a90c-dc6c1accfff7 service nova] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_members [ 621.167144] env[66123]: INFO networking_nsxv3.common.synchronization [req-81144cc0-5221-455a-b14d-015373b1f892 req-22bda68f-2243-411c-a90c-dc6c1accfff7 service nova] Enqueued Resource ID: 7b3213dc-c1ef-419e-93a3-34a959ff655f with Priority: HIGHEST for action port [ 621.167696] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_rules [ 621.167836] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_members [ 621.167934] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3213dc-c1ef-419e-93a3-34a959ff655f with Priority: HIGHEST for action port [ 621.169175] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.169290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.169402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.169853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.169853] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.170790] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.170938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.171013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.171215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.171578] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.172427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.173333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.173679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.173813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.174485] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.178245] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b3213dc-c1ef-419e-93a3-34a959ff655f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.180347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.180347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.180347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.180347] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b3213dc-c1ef-419e-93a3-34a959ff655f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.198370] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76: rpc.has_security_group_logging(os_id): False [ 621.213805] env[66123]: INFO networking_nsxv3.common.synchronization [None req-897f4c45-c6b4-4dc1-a850-36e254418e14 None None] Enqueued Resource ID: 953b9f84-1ef1-4490-8173-a01d5e981ecd with Priority: HIGHEST for action port [ 621.214281] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 953b9f84-1ef1-4490-8173-a01d5e981ecd with Priority: HIGHEST for action port [ 621.215060] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-953b9f84-1ef1-4490-8173-a01d5e981ecd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.215060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-953b9f84-1ef1-4490-8173-a01d5e981ecd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.215060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-953b9f84-1ef1-4490-8173-a01d5e981ecd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.215060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-953b9f84-1ef1-4490-8173-a01d5e981ecd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.215060] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('953b9f84-1ef1-4490-8173-a01d5e981ecd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.221235] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.221235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.221235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.221366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.221366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.221562] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.221785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.221785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.221873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.221939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.222169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.222321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.222632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.222632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.222755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.223529] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.223529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.223529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.223529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.223529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.223529] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 is going to be created. [ 621.304549] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.304549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.304688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.304854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.305061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.316514] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 in Status: IN_PROGRESS for 2s [ 621.508333] env[66123]: INFO networking_nsxv3.common.synchronization [req-5e30ebd4-3fb8-4f4a-8e59-8f50ad7d9205 req-40007fd3-daf5-4824-b692-1d0e8053d40b tempest-SecurityGroupRulesNegativeTestJSON-1906833283 tempest-SecurityGroupRulesNegativeTestJSON-1906833283-project-member] Enqueued Resource ID: 333e737d-9706-42d7-9a3f-8404c71adc00 with Priority: HIGHEST for action security_group_rules [ 621.509224] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e737d-9706-42d7-9a3f-8404c71adc00 with Priority: HIGHEST for action security_group_rules [ 621.510235] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e737d-9706-42d7-9a3f-8404c71adc00 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.510235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.510235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.510475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.510475] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e737d-9706-42d7-9a3f-8404c71adc00',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.594805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.595676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.595676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.595676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.596195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.596195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.596332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.597323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.597323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.597323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.597323] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.597323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.597548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.597656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.598151] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.598151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.598151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.598314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.598425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.598551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.598830] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.679733] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.684919] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.684919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.686898] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b3213dc-c1ef-419e-93a3-34a959ff655f with status ACTIVE [ 621.687172] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.687320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.687388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.687698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.687845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.688238] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.688346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.688447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.688897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.688897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.689294] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.689394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.689635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.689751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.689872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.690019] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b3213dc-c1ef-419e-93a3-34a959ff655f is going to be updated. [ 621.717700] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 953b9f84-1ef1-4490-8173-a01d5e981ecd [ 621.718023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.718164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.718164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.718491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.718596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.718693] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:953b9f84-1ef1-4490-8173-a01d5e981ecd already deleted. [ 621.718806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-953b9f84-1ef1-4490-8173-a01d5e981ecd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.741697] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.742258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.742384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.742670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.742998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.742998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b3213dc-c1ef-419e-93a3-34a959ff655f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.033562] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.034120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.034120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.034120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.034120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.034329] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e737d-9706-42d7-9a3f-8404c71adc00 already deleted. [ 622.034329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.044927] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7aba81fd-4727-4d87-b9a4-c4cb59d536a1 None None] Enqueued Resource ID: 3c0c60b5-0075-46b6-8ca2-5a26900ed50e with Priority: HIGHEST for action port [ 622.045512] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c0c60b5-0075-46b6-8ca2-5a26900ed50e with Priority: HIGHEST for action port [ 622.046097] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c0c60b5-0075-46b6-8ca2-5a26900ed50e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.046097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c0c60b5-0075-46b6-8ca2-5a26900ed50e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.046097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c0c60b5-0075-46b6-8ca2-5a26900ed50e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.046433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c0c60b5-0075-46b6-8ca2-5a26900ed50e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.046518] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c0c60b5-0075-46b6-8ca2-5a26900ed50e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.103708] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2: rpc.has_security_group_logging(os_id): False [ 622.125525] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.125525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.125525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.125525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.125525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.125525] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.125525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.125525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.126146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.126146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.126146] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.126146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.126146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.126575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.126575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.126575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.126736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.126736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.127749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.127749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.127749] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 622.186493] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.205148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.205148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.205148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.205415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.205415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.224986] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 622.548816] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c0c60b5-0075-46b6-8ca2-5a26900ed50e [ 622.549144] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.549427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.549533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.549920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.550057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.550256] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c0c60b5-0075-46b6-8ca2-5a26900ed50e already deleted. [ 622.550370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c0c60b5-0075-46b6-8ca2-5a26900ed50e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.689459] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.690056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.692789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.693118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.693302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.693471] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 is going to be created. [ 622.725328] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.725527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.725527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.728362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.728362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.739980] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: UNINITIALIZED for 2s [ 623.330699] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 in Status: SUCCESS [ 623.331169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.240223] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 624.240470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.391215] env[66123]: INFO networking_nsxv3.common.synchronization [req-2c939229-d30c-4c2b-94c7-5611c8cf0a69 req-a36f4e65-7d99-4dcf-972b-935ccfa78bda tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 624.391505] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 624.392042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.392042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.392042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.392547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.392547] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.392697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.392780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.393092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.393407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.393555] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.564597] env[66123]: INFO networking_nsxv3.common.synchronization [None req-890afbab-e6be-478d-88d9-fc2fdd87ab92 None None] Enqueued Resource ID: 4a3372b5-28e7-4b89-8d25-2e2a19f755ba with Priority: HIGHEST for action port [ 624.565438] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a3372b5-28e7-4b89-8d25-2e2a19f755ba with Priority: HIGHEST for action port [ 624.566090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a3372b5-28e7-4b89-8d25-2e2a19f755ba taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.566090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a3372b5-28e7-4b89-8d25-2e2a19f755ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.566090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a3372b5-28e7-4b89-8d25-2e2a19f755ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.566442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a3372b5-28e7-4b89-8d25-2e2a19f755ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.567010] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a3372b5-28e7-4b89-8d25-2e2a19f755ba',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.752349] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: SUCCESS [ 624.753087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.753087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.753204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.753411] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.753476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.753526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.753722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.753805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.753952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.754375] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.897106] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.897106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.897252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.897747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.897747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.897747] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.897914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.897914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.897995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.898085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.898168] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 already deleted. [ 624.898255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.073812] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a3372b5-28e7-4b89-8d25-2e2a19f755ba [ 625.073812] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.073812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.073812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.073812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.073812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.073812] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a3372b5-28e7-4b89-8d25-2e2a19f755ba already deleted. [ 625.073812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a3372b5-28e7-4b89-8d25-2e2a19f755ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.258389] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.294413] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-264 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.294650] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.294774] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.295127] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.295388] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.295539] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.295648] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.295869] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.299024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.299024] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.299024] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.299024] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.299024] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.299024] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.299024] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.299024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.326209] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.326675] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.326675] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.326803] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.327578] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.327578] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.327578] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.328189] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.329735] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3972bb64-a04f-4637-ade1-b5d3a3a9e30a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.762243] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63ce70da-7be6-4476-bdbe-08aaf4677d57: rpc.has_security_group_logging(os_id): False [ 625.785882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.786105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.786105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.786351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.786447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.786707] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.786808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.786868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.787024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.787099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.787185] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 is going to be created. [ 625.832024] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.832380] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.832632] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.832883] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.833089] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.833301] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 3972bb64-a04f-4637-ade1-b5d3a3a9e30a not found, creating... [ 625.833677] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.833798] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.833962] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.834222] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.834384] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.835329] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.835611] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.835666] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.835941] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.836106] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.836283] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 3972bb64-a04f-4637-ade1-b5d3a3a9e30a is going to be created. [ 625.866970] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.866970] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.866970] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.866970] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.867795] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.867795] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.876448] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.877586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.877586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.877586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.877586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.889760] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: IN_PROGRESS for 2s [ 625.917895] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e20c0e6f-bfe0-4f57-a69f-ef2604475a76 None None] Enqueued Resource ID: c1d2013d-aea3-4369-9373-4b59d7da2f24 with Priority: HIGHEST for action port [ 625.918122] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d2013d-aea3-4369-9373-4b59d7da2f24 with Priority: HIGHEST for action port [ 625.918435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1d2013d-aea3-4369-9373-4b59d7da2f24 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.918562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1d2013d-aea3-4369-9373-4b59d7da2f24" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.918630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1d2013d-aea3-4369-9373-4b59d7da2f24" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.919353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1d2013d-aea3-4369-9373-4b59d7da2f24" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.919443] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1d2013d-aea3-4369-9373-4b59d7da2f24',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.176519] env[66123]: INFO networking_nsxv3.common.synchronization [None req-9c46579c-c4ac-4ef1-975d-e8f990979c17 None None] Enqueued Resource ID: de5e8dee-67bb-44f2-8c09-014db7e834ee with Priority: HIGHEST for action port [ 626.177098] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5e8dee-67bb-44f2-8c09-014db7e834ee with Priority: HIGHEST for action port [ 626.177438] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-de5e8dee-67bb-44f2-8c09-014db7e834ee taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.177558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de5e8dee-67bb-44f2-8c09-014db7e834ee" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.177628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de5e8dee-67bb-44f2-8c09-014db7e834ee" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.177943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de5e8dee-67bb-44f2-8c09-014db7e834ee" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.178053] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de5e8dee-67bb-44f2-8c09-014db7e834ee',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.422325] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1d2013d-aea3-4369-9373-4b59d7da2f24 [ 626.422540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.422975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.422975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.422975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.423164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.423164] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1d2013d-aea3-4369-9373-4b59d7da2f24 already deleted. [ 626.423296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1d2013d-aea3-4369-9373-4b59d7da2f24" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.628315] env[66123]: INFO networking_nsxv3.common.synchronization [req-2c939229-d30c-4c2b-94c7-5611c8cf0a69 req-fe5ed33b-2c17-4fe1-98d4-e70d3babfabf service nova] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_rules [ 626.628462] env[66123]: INFO networking_nsxv3.common.synchronization [req-2c939229-d30c-4c2b-94c7-5611c8cf0a69 req-fe5ed33b-2c17-4fe1-98d4-e70d3babfabf service nova] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 626.628613] env[66123]: INFO networking_nsxv3.common.synchronization [req-2c939229-d30c-4c2b-94c7-5611c8cf0a69 req-fe5ed33b-2c17-4fe1-98d4-e70d3babfabf service nova] Enqueued Resource ID: 3972bb64-a04f-4637-ade1-b5d3a3a9e30a with Priority: HIGHEST for action port [ 626.629214] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_rules [ 626.630476] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 626.630476] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3972bb64-a04f-4637-ade1-b5d3a3a9e30a with Priority: HIGHEST for action port [ 626.630476] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.630476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.630476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.630476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.630965] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.631905] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.632103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.632103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.632366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.632553] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.632669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.632742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.632917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.633049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.633153] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.637340] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.637340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.637340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.637340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.637340] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3972bb64-a04f-4637-ade1-b5d3a3a9e30a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.682455] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de5e8dee-67bb-44f2-8c09-014db7e834ee [ 626.682455] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.682455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.682455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.682455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.682455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.682455] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de5e8dee-67bb-44f2-8c09-014db7e834ee already deleted. [ 626.682455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de5e8dee-67bb-44f2-8c09-014db7e834ee" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.137295] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.138204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.140985] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.142075] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3972bb64-a04f-4637-ade1-b5d3a3a9e30a with status ACTIVE [ 627.142391] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.142595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.142862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.143183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.143315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.143547] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.143682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.143763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.143957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.145022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.145022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.145022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.145022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.145022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.145022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.145022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3972bb64-a04f-4637-ade1-b5d3a3a9e30a is going to be updated. [ 627.170923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.170923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.170923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.170923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.171258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.171258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3972bb64-a04f-4637-ade1-b5d3a3a9e30a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.331728] env[66123]: INFO networking_nsxv3.common.synchronization [req-564653eb-3d65-42ac-b207-a6c79c30002b req-4fcde287-83c7-4762-ab98-406d2e6cfdd7 tempest-ServerActionsV293TestJSON-94308629 tempest-ServerActionsV293TestJSON-94308629-project-member] Enqueued Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_members [ 627.332581] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_members [ 627.333104] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.333239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.333280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.333708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.333949] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.334136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.334241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.334539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.334788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.335023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.647107] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.839388] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.839554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.839554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.840157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.840157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.841548] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.841548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.841548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.841548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.841548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.841548] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 already deleted. [ 627.841548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.908049] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: SUCCESS [ 627.908201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.099468] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.099468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-885" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.099468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-885" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.099468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-885" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.099864] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.102969] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.102969] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.102969] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.102969] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.102969] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.102969] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.102969] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.102969] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.102969] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.102969] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.102969] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.128348] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.128348] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.128348] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.128348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-885" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.128348] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.128348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.128348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.128676] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.128676] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a44a96b-0f4b-433d-9eac-d10cd8f0d80a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.151757] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.152163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.152163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.152237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.153202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.153202] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be created. [ 628.180877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.180877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.180877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.180877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.181376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.193164] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: UNINITIALIZED for 2s [ 628.631796] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.632065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.632250] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.632557] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.632748] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.633112] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 4a44a96b-0f4b-433d-9eac-d10cd8f0d80a not found, creating... [ 628.633262] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.633489] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.633640] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.633884] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.634082] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.634636] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.634886] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.634939] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.635815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.636089] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.636282] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 4a44a96b-0f4b-433d-9eac-d10cd8f0d80a is going to be created. [ 628.660140] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.660707] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.660707] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.660988] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.661153] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.661433] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.694889] env[66123]: INFO networking_nsxv3.common.synchronization [None req-fc1c01e0-f7e1-4b08-9d9a-99aebb6d7c3c None None] Enqueued Resource ID: 620aff98-548f-4ded-b071-e5dacfe7401d with Priority: HIGHEST for action port [ 628.694889] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620aff98-548f-4ded-b071-e5dacfe7401d with Priority: HIGHEST for action port [ 628.694889] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-620aff98-548f-4ded-b071-e5dacfe7401d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.695320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-620aff98-548f-4ded-b071-e5dacfe7401d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.695320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-620aff98-548f-4ded-b071-e5dacfe7401d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.696015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-620aff98-548f-4ded-b071-e5dacfe7401d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.696015] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('620aff98-548f-4ded-b071-e5dacfe7401d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.965725] env[66123]: INFO networking_nsxv3.common.synchronization [None req-b957ee4a-8bc3-40e1-a6bd-4a9785cfe88e None None] Enqueued Resource ID: d4df3108-798e-424f-8fb0-9faed97c5c2b with Priority: HIGHEST for action port [ 628.966353] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4df3108-798e-424f-8fb0-9faed97c5c2b with Priority: HIGHEST for action port [ 628.966660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4df3108-798e-424f-8fb0-9faed97c5c2b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.967066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4df3108-798e-424f-8fb0-9faed97c5c2b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.967066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4df3108-798e-424f-8fb0-9faed97c5c2b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.967204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4df3108-798e-424f-8fb0-9faed97c5c2b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.967324] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4df3108-798e-424f-8fb0-9faed97c5c2b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.201239] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 620aff98-548f-4ded-b071-e5dacfe7401d [ 629.201239] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.201239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.201239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.203759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.203759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.203759] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:620aff98-548f-4ded-b071-e5dacfe7401d already deleted. [ 629.203759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-620aff98-548f-4ded-b071-e5dacfe7401d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.409490] env[66123]: INFO networking_nsxv3.common.synchronization [req-564653eb-3d65-42ac-b207-a6c79c30002b req-32ee694e-0fc7-4590-bd43-74cddc9c19fb service nova] Enqueued Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_rules [ 629.409584] env[66123]: INFO networking_nsxv3.common.synchronization [req-564653eb-3d65-42ac-b207-a6c79c30002b req-32ee694e-0fc7-4590-bd43-74cddc9c19fb service nova] Enqueued Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_members [ 629.410530] env[66123]: INFO networking_nsxv3.common.synchronization [req-564653eb-3d65-42ac-b207-a6c79c30002b req-32ee694e-0fc7-4590-bd43-74cddc9c19fb service nova] Enqueued Resource ID: 4a44a96b-0f4b-433d-9eac-d10cd8f0d80a with Priority: HIGHEST for action port [ 629.410530] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_rules [ 629.410530] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_members [ 629.410530] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a44a96b-0f4b-433d-9eac-d10cd8f0d80a with Priority: HIGHEST for action port [ 629.411087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.411329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.411329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.411484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.411564] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.412435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.412578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.412642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.412766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.413246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.413246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.413246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.413246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.413486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.413486] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.415238] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.415238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.415238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.415238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.415238] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a44a96b-0f4b-433d-9eac-d10cd8f0d80a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.470731] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4df3108-798e-424f-8fb0-9faed97c5c2b [ 629.470923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.471143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.471274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.471654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.471823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.472422] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4df3108-798e-424f-8fb0-9faed97c5c2b already deleted. [ 629.472422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4df3108-798e-424f-8fb0-9faed97c5c2b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.915903] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.916176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.920558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a44a96b-0f4b-433d-9eac-d10cd8f0d80a with status ACTIVE [ 629.920882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.921038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.921038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.921456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.921456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.921546] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.921598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.921710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.921821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.921899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.922107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.922206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.922301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.922495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.922578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.922662] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a44a96b-0f4b-433d-9eac-d10cd8f0d80a is going to be updated. [ 629.923832] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.949256] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.949406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.949471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.949907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.949907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.950037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a44a96b-0f4b-433d-9eac-d10cd8f0d80a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.209023] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.209023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.209023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.209023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.426929] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.714219] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.714389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.714389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.715047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.715047] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.715047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.715047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.715292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.715292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.715388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.715488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.715601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.715671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.716075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.716075] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.716173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.716206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.716369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.716454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.716544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.716639] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.931896] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.931896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.931896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.931896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.931896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.931896] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 is going to be created. [ 630.961040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.961215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.961268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.961519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.961809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.975034] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 in Status: UNINITIALIZED for 2s [ 631.220611] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69e73b71-1b94-4c07-a51a-893782ee1e09: rpc.has_security_group_logging(os_id): False [ 631.238757] env[66123]: INFO networking_nsxv3.common.synchronization [None req-31fb533f-c0ed-4536-8942-6e231c61ce73 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_rules [ 631.241115] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_rules [ 631.244352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.244525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.244635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.245078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.245078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.245207] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.245262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.245329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.245511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.245603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.245810] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.245909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.245978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.246191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.246272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.246472] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.246586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.246658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.246875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.246875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.246973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be created. [ 631.248185] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.248294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.248354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.248584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.248683] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.348328] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.348525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.348565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.348775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.350345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.363555] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 631.511061] env[66123]: INFO networking_nsxv3.common.synchronization [None req-6475a3f4-dfe1-4409-b881-69baa9490cb9 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_rules [ 631.511578] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_rules [ 631.511851] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.511946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.789162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.789333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.789516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.789797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.789913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.790026] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c already deleted. [ 631.790116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.790346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.791030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.791030] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.321238] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.321238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.321238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.321238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.321238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.321238] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c already deleted. [ 632.321238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.995100] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 in Status: SUCCESS [ 632.995361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.995509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.995736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.995952] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.996097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.996171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.996326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.996409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.996495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.998881] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.197593] env[66123]: INFO networking_nsxv3.common.synchronization [req-5d7552f7-72b0-4f19-8ebe-6d5c0870fd28 req-5763e7cb-5e1a-4cc4-8ac1-688c80025bc8 tempest-SecurityGroupRulesNegativeTestJSON-1906833283 tempest-SecurityGroupRulesNegativeTestJSON-1906833283-project-member] Enqueued Resource ID: 333e737d-9706-42d7-9a3f-8404c71adc00 with Priority: HIGHEST for action security_group_rules [ 633.198143] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e737d-9706-42d7-9a3f-8404c71adc00 with Priority: HIGHEST for action security_group_rules [ 633.198439] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e737d-9706-42d7-9a3f-8404c71adc00 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.198561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.198627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.198826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.199056] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e737d-9706-42d7-9a3f-8404c71adc00',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.375610] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 633.375923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.499844] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.715189] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ac4be564-2559-4a31-ae27-4841a2ad456d None None] Enqueued Resource ID: 8f87eca3-db7d-4189-ace6-1495d5ec69cd with Priority: HIGHEST for action port [ 633.715726] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f87eca3-db7d-4189-ace6-1495d5ec69cd with Priority: HIGHEST for action port [ 633.716392] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f87eca3-db7d-4189-ace6-1495d5ec69cd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.716537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f87eca3-db7d-4189-ace6-1495d5ec69cd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.716638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f87eca3-db7d-4189-ace6-1495d5ec69cd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.716910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f87eca3-db7d-4189-ace6-1495d5ec69cd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.717113] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f87eca3-db7d-4189-ace6-1495d5ec69cd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.728956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.728956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.728956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.728956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.729345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.729345] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e737d-9706-42d7-9a3f-8404c71adc00 already deleted. [ 633.729345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e737d-9706-42d7-9a3f-8404c71adc00" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.999495] env[66123]: INFO networking_nsxv3.common.synchronization [req-8a79d29f-6d83-4ae4-9468-3c31f0a4f3b0 req-ac58a78b-4f27-4b4e-b090-5b5192bc701c tempest-ServersWithSpecificFlavorTestJSON-678692171 tempest-ServersWithSpecificFlavorTestJSON-678692171-project-member] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 633.999953] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 634.000098] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.000173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.000669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.000669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.000669] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.000856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.000856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.001012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.001012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.001105] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.005531] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6be2818f-6bbe-47a1-a41d-086de5f4b5d0: rpc.has_security_group_logging(os_id): False [ 634.026997] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.027256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.027373] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.028116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.028116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.028116] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.028116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.028116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.028408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.028505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.028607] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 is going to be created. [ 634.099264] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.099264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.099264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.099264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.099264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.116024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 in Status: IN_PROGRESS for 2s [ 634.221328] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f87eca3-db7d-4189-ace6-1495d5ec69cd [ 634.221550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.221663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.221734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.221930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.222102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.222187] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f87eca3-db7d-4189-ace6-1495d5ec69cd already deleted. [ 634.222271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f87eca3-db7d-4189-ace6-1495d5ec69cd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.503574] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.504033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.504033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.504181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.504181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.504366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.504494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.504682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.504758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.504824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.504876] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc already deleted. [ 634.504946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.779987] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-879 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.779987] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.779987] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.780224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.784366] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.784840] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.784840] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.785121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.787081] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.787081] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.787081] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.787081] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.787081] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.787081] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.787081] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.787081] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.809506] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.809949] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.810099] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.811500] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.811815] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-8dc7c157-239d-4719-b519-5cabfa3f1ddc taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.812038] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.812212] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.812615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.812949] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc7c157-239d-4719-b519-5cabfa3f1ddc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.315045] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.315343] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.315726] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.316053] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.316214] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.316376] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 8dc7c157-239d-4719-b519-5cabfa3f1ddc not found, creating... [ 635.316642] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.316927] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.316927] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.317140] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.317270] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.317543] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.317694] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.317805] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.318388] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.318590] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.318749] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 8dc7c157-239d-4719-b519-5cabfa3f1ddc is going to be created. [ 635.344571] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.346071] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.346309] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.346630] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.347502] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.347811] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.103874] env[66123]: INFO networking_nsxv3.common.synchronization [req-8a79d29f-6d83-4ae4-9468-3c31f0a4f3b0 req-96988fa9-6b35-4e88-a80c-afc66b1446eb service nova] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 636.104243] env[66123]: INFO networking_nsxv3.common.synchronization [req-8a79d29f-6d83-4ae4-9468-3c31f0a4f3b0 req-96988fa9-6b35-4e88-a80c-afc66b1446eb service nova] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 636.104243] env[66123]: INFO networking_nsxv3.common.synchronization [req-8a79d29f-6d83-4ae4-9468-3c31f0a4f3b0 req-96988fa9-6b35-4e88-a80c-afc66b1446eb service nova] Enqueued Resource ID: 8dc7c157-239d-4719-b519-5cabfa3f1ddc with Priority: HIGHEST for action port [ 636.105079] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 636.105291] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 636.105445] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dc7c157-239d-4719-b519-5cabfa3f1ddc with Priority: HIGHEST for action port [ 636.105786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.105993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.106118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.106369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.106504] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.107838] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.110286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.110286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.110286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.110286] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.110286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.110286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.110286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.110286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.110286] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.111663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dc7c157-239d-4719-b519-5cabfa3f1ddc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.112272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.112272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.112272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.112272] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc7c157-239d-4719-b519-5cabfa3f1ddc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.128149] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 in Status: SUCCESS [ 636.128149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.516666] env[66123]: INFO networking_nsxv3.common.synchronization [None req-dd2fbecb-5188-4915-bd45-cc9bdda9b500 None None] Enqueued Resource ID: 29cc81b4-fbb9-4ec6-98be-f33919a1e81a with Priority: HIGHEST for action port [ 636.517318] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cc81b4-fbb9-4ec6-98be-f33919a1e81a with Priority: HIGHEST for action port [ 636.517736] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-29cc81b4-fbb9-4ec6-98be-f33919a1e81a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.517891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29cc81b4-fbb9-4ec6-98be-f33919a1e81a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.517891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29cc81b4-fbb9-4ec6-98be-f33919a1e81a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.518686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29cc81b4-fbb9-4ec6-98be-f33919a1e81a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.518835] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29cc81b4-fbb9-4ec6-98be-f33919a1e81a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.562923] env[66123]: INFO networking_nsxv3.common.synchronization [req-2785c112-e900-4302-b20f-b950afa38f60 req-d2a18cf4-b824-44f9-bfe8-925701b0f26d tempest-DeleteServersAdminTestJSON-1729712883 tempest-DeleteServersAdminTestJSON-1729712883-project-member] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 636.564149] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 636.564559] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.564709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.564787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.565020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.566071] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.566179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.566290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.566473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.566594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.566712] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.614354] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.616396] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.616396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.616396] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dc7c157-239d-4719-b519-5cabfa3f1ddc with status ACTIVE [ 636.616396] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.616772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.616772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.616772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.617056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.617056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.617264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.617866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.618194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.618282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.618496] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.618613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.618672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.618824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.618909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.619086] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dc7c157-239d-4719-b519-5cabfa3f1ddc is going to be updated. [ 636.653919] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.653919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.653919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.653919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.653919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.653919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dc7c157-239d-4719-b519-5cabfa3f1ddc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.023803] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29cc81b4-fbb9-4ec6-98be-f33919a1e81a [ 637.024061] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.024204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.024441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.024554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.024647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.024778] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29cc81b4-fbb9-4ec6-98be-f33919a1e81a already deleted. [ 637.024870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29cc81b4-fbb9-4ec6-98be-f33919a1e81a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.069098] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.069265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.069328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.069553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.069650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.069891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.069955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.070013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.070175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.070339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.070436] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be updated. [ 637.090710] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.091057] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.091269] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.092231] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.092429] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.092679] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.092864] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.093734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.093734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.094033] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.094033] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.094125] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.094290] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.094456] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.094614] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.094817] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.105687] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.106698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.106698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.106698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.106698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.116639] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.122255] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: IN_PROGRESS for 2s [ 637.123882] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.123882] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.123882] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.124281] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.124429] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-17b45c3a-bbcc-4902-8dbd-bc691871d51b taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.124608] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.124723] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.125088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.125200] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b45c3a-bbcc-4902-8dbd-bc691871d51b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.621069] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.621322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.621322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.621536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.621761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.621761] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be created. [ 637.628074] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.629931] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.630229] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.630655] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.630853] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.631079] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 17b45c3a-bbcc-4902-8dbd-bc691871d51b not found, creating... [ 637.631454] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.631687] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.631820] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.632110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.632304] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.632729] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.632948] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.633062] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.633312] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.633575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.633760] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 17b45c3a-bbcc-4902-8dbd-bc691871d51b is going to be created. [ 637.658955] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.659339] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.659535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.659896] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.660152] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.660444] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.662772] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.662976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.663062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.663262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.663446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.677639] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: UNINITIALIZED for 2s [ 638.369167] env[66123]: INFO networking_nsxv3.common.synchronization [req-2785c112-e900-4302-b20f-b950afa38f60 req-f66f805c-7ca2-43a3-8a93-0656dc21a3cc service nova] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_rules [ 638.369480] env[66123]: INFO networking_nsxv3.common.synchronization [req-2785c112-e900-4302-b20f-b950afa38f60 req-f66f805c-7ca2-43a3-8a93-0656dc21a3cc service nova] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 638.369480] env[66123]: INFO networking_nsxv3.common.synchronization [req-2785c112-e900-4302-b20f-b950afa38f60 req-f66f805c-7ca2-43a3-8a93-0656dc21a3cc service nova] Enqueued Resource ID: 17b45c3a-bbcc-4902-8dbd-bc691871d51b with Priority: HIGHEST for action port [ 638.370027] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_rules [ 638.370182] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 638.370398] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b45c3a-bbcc-4902-8dbd-bc691871d51b with Priority: HIGHEST for action port [ 638.370554] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.370678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.370747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.370964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.371097] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.374794] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.375400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.375657] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-17b45c3a-bbcc-4902-8dbd-bc691871d51b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.375803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.375803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.376100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.376586] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b45c3a-bbcc-4902-8dbd-bc691871d51b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.875451] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.875654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.881339] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17b45c3a-bbcc-4902-8dbd-bc691871d51b with status ACTIVE [ 638.881339] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.881339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.881339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.881339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.881339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.883313] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.883313] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.883313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.883313] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17b45c3a-bbcc-4902-8dbd-bc691871d51b is going to be updated. [ 638.907387] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.907593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.907709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.907905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.908047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.908204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17b45c3a-bbcc-4902-8dbd-bc691871d51b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.974319] env[66123]: INFO networking_nsxv3.common.synchronization [req-08f58fba-52b5-4e2f-82e0-16e441b440aa req-0a68a157-385f-479d-a088-7b51512eda0d tempest-VolumesAdminNegativeTest-530114969 tempest-VolumesAdminNegativeTest-530114969-project-member] Enqueued Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_members [ 638.974914] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_members [ 638.975233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.975490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.975490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.975703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.975878] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.975982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.976058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.976218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.976526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.976648] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.014233] env[66123]: INFO networking_nsxv3.common.synchronization [None req-3c903b35-8b82-499c-bec5-a1c31cd00f7e None None] Enqueued Resource ID: a1ec16db-9b5f-4b3e-bf93-d605aeab6933 with Priority: HIGHEST for action port [ 639.014847] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ec16db-9b5f-4b3e-bf93-d605aeab6933 with Priority: HIGHEST for action port [ 639.015175] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1ec16db-9b5f-4b3e-bf93-d605aeab6933 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.015319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1ec16db-9b5f-4b3e-bf93-d605aeab6933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.015485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1ec16db-9b5f-4b3e-bf93-d605aeab6933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.015613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1ec16db-9b5f-4b3e-bf93-d605aeab6933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.015688] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1ec16db-9b5f-4b3e-bf93-d605aeab6933',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.134852] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: SUCCESS [ 639.135381] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 deletion is rescheduled due to dependency. [ 639.135381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.135381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.135576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.135730] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.135850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.135904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.136079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.136162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.136294] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.436086] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.436489] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-836" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.436489] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-836" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.437803] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-836" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.438104] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.438832] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.438832] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.438832] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.438832] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.439062] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.439101] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.439211] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.439319] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.439384] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.440065] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.440065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.461359] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.461359] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.461359] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.461359] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-836" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.461359] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-759f7d8b-13c9-4f98-b236-d377427335b2 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.461359] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.461359] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.461756] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.462722] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759f7d8b-13c9-4f98-b236-d377427335b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.480468] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.480672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.480751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.481015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.481131] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.481701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.481701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.481701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.481938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.482894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.482894] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acae7498-6eb9-4817-9d61-924a64d54580 already deleted. [ 639.482894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.518338] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1ec16db-9b5f-4b3e-bf93-d605aeab6933 [ 639.518585] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.518720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.518789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.519013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.519112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.519207] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1ec16db-9b5f-4b3e-bf93-d605aeab6933 already deleted. [ 639.519291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1ec16db-9b5f-4b3e-bf93-d605aeab6933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.638252] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.688423] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 639.688703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.688879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.689114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.689312] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.689443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.689515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.690665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.690665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.690665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.690665] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.767012] env[66123]: INFO networking_nsxv3.common.synchronization [req-424f14ce-ef0e-4366-bbd9-fbbed6e6b62c req-366d88c2-e497-41a5-bf02-726fe3828db8 tempest-ServerDiagnosticsTest-1510758604 tempest-ServerDiagnosticsTest-1510758604-project-member] Enqueued Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_members [ 639.767622] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGHEST for action security_group_members [ 639.767948] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.773715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.773715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.773715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.773715] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.773715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.773715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.773715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.773715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.773715] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.966596] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.966842] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.966963] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.967282] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.967422] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.967567] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 759f7d8b-13c9-4f98-b236-d377427335b2 not found, creating... [ 639.967817] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.969567] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.969567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.969567] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 759f7d8b-13c9-4f98-b236-d377427335b2 is going to be created. [ 639.991856] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.992094] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.992198] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.992679] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.992940] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.993205] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.140848] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.193946] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.275925] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.276387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.276533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.276859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.276986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.277436] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.277571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.277697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.277935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.278041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.278143] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b is going to be updated. [ 640.316658] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.316942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.316942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.317128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.317359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.329179] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b in Status: IN_PROGRESS for 2s [ 640.644353] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.644353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.644353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.644353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.645571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.645571] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be updated. [ 640.678915] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.678915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.678915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.679292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.679292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.693677] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: IN_PROGRESS for 2s [ 640.698768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3af04420-6b85-4613-8554-92a0065c78dc: rpc.has_security_group_logging(os_id): False [ 640.721072] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.721253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.721311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.721544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.721544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.721544] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.721544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.721544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.721544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.721544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.721544] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be created. [ 640.789035] env[66123]: INFO networking_nsxv3.common.synchronization [req-08f58fba-52b5-4e2f-82e0-16e441b440aa req-a27d77b2-aa91-4aa7-8e9e-7be6472ae85e service nova] Enqueued Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_rules [ 640.789035] env[66123]: INFO networking_nsxv3.common.synchronization [req-08f58fba-52b5-4e2f-82e0-16e441b440aa req-a27d77b2-aa91-4aa7-8e9e-7be6472ae85e service nova] Enqueued Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_members [ 640.789226] env[66123]: INFO networking_nsxv3.common.synchronization [req-08f58fba-52b5-4e2f-82e0-16e441b440aa req-a27d77b2-aa91-4aa7-8e9e-7be6472ae85e service nova] Enqueued Resource ID: 759f7d8b-13c9-4f98-b236-d377427335b2 with Priority: HIGHEST for action port [ 640.790340] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.790498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.790582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.790771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.790997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.795773] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_rules [ 640.795773] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_members [ 640.796545] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759f7d8b-13c9-4f98-b236-d377427335b2 with Priority: HIGHEST for action port [ 640.796545] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.796658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.796956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.796997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.797100] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.798025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.799138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.799138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.799259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.800423] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.800423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.800423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.800423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.800423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.800423] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.802149] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-759f7d8b-13c9-4f98-b236-d377427335b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.802149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.802149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.802149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.802149] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759f7d8b-13c9-4f98-b236-d377427335b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.815645] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: IN_PROGRESS for 2s [ 641.304069] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.306957] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.307383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.307790] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 759f7d8b-13c9-4f98-b236-d377427335b2 with status ACTIVE [ 641.308320] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.309774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.309774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.309774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.309774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.312022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.312022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.312022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.312022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 759f7d8b-13c9-4f98-b236-d377427335b2 is going to be updated. [ 641.345472] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.345472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.345472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.345472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.345472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.345472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-759f7d8b-13c9-4f98-b236-d377427335b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.386232] env[66123]: INFO networking_nsxv3.common.synchronization [req-a3d36c2b-fec4-464b-af6e-50115107bc41 req-09f32d43-9b4d-48f4-aa9e-d89ce4e51c37 tempest-FloatingIPsAssociationTestJSON-1710505517 tempest-FloatingIPsAssociationTestJSON-1710505517-project-member] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 641.386622] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 641.389193] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.389193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.389193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.389193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.389193] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.389193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.389193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.389193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.389645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.389645] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.443579] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ebed31fa-aa0d-4e40-884f-2f46856b7a99 None None] Enqueued Resource ID: 993db613-0e2d-4c8e-87a1-4fd70e601fc5 with Priority: HIGHEST for action port [ 641.444266] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993db613-0e2d-4c8e-87a1-4fd70e601fc5 with Priority: HIGHEST for action port [ 641.444646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-993db613-0e2d-4c8e-87a1-4fd70e601fc5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.444785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-993db613-0e2d-4c8e-87a1-4fd70e601fc5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.444851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-993db613-0e2d-4c8e-87a1-4fd70e601fc5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.447238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-993db613-0e2d-4c8e-87a1-4fd70e601fc5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.447350] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993db613-0e2d-4c8e-87a1-4fd70e601fc5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.806546] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.891122] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.921229] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.921413] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.921573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.921784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.922047] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.922410] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.922410] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.922544] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.922834] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.922900] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.922964] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.923109] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.923287] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.923337] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.923408] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.923531] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.950291] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.950542] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.950882] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.951076] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-573" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.951429] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-a71f285d-84fa-4910-b7a8-8db5106f6d90 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.951630] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.951755] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.952095] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.952257] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a71f285d-84fa-4910-b7a8-8db5106f6d90',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.953336] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 993db613-0e2d-4c8e-87a1-4fd70e601fc5 [ 641.953570] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.953673] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.953742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.953913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.954043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.954147] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:993db613-0e2d-4c8e-87a1-4fd70e601fc5 already deleted. [ 641.954225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-993db613-0e2d-4c8e-87a1-4fd70e601fc5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.003989] env[66123]: INFO networking_nsxv3.common.synchronization [req-7c0ab9e5-46db-4f48-8d33-b28f5b030b16 req-05200589-e7d1-4ff9-b764-1e120d73bf1e tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 642.004486] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 642.004853] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.004982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.005090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.005297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.005454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.005558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.005619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.005763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.005849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.005941] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.309524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.309684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.309779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.310062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.310159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.310204] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acae7498-6eb9-4817-9d61-924a64d54580 is going to be created. [ 642.344525] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b in Status: SUCCESS [ 642.344861] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b deletion is rescheduled due to dependency. [ 642.344991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.346358] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.346553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.346626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.346926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.347322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.364165] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acae7498-6eb9-4817-9d61-924a64d54580 in Status: UNINITIALIZED for 2s [ 642.393902] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.415518] env[66123]: INFO networking_nsxv3.common.synchronization [req-7c0ab9e5-46db-4f48-8d33-b28f5b030b16 req-afa7e7b2-9c5c-4c1b-ae86-8f661ab7100d tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 642.416090] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 642.416404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.417063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.455681] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.456358] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.456358] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.456700] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.456807] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.456989] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port a71f285d-84fa-4910-b7a8-8db5106f6d90 not found, creating... [ 642.457327] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.457503] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.457630] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.457892] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.457981] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.458284] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.458441] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.458565] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.458868] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.458937] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.459117] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: a71f285d-84fa-4910-b7a8-8db5106f6d90 is going to be created. [ 642.482117] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.482969] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.483297] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.483620] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.483850] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.484151] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.507566] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.706326] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: SUCCESS [ 642.706740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.707067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.707442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.707740] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.707950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.708078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.708376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.708541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.708736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.708933] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.828560] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 642.828560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.897242] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.897415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.897489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.897705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.897798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.897900] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be updated. [ 642.928417] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.928627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.928627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.928833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.928985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.939897] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: IN_PROGRESS for 2s [ 643.010937] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.174563] env[66123]: INFO networking_nsxv3.common.synchronization [req-7c0ab9e5-46db-4f48-8d33-b28f5b030b16 req-cbc51d21-465c-43e4-8316-6561e5fc5896 tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 643.175566] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 643.175707] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.175906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.182462] env[66123]: INFO networking_nsxv3.common.synchronization [req-a3d36c2b-fec4-464b-af6e-50115107bc41 req-5e6086d8-799e-46fa-888f-6dcae4d9528a service nova] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_rules [ 643.182462] env[66123]: INFO networking_nsxv3.common.synchronization [req-a3d36c2b-fec4-464b-af6e-50115107bc41 req-5e6086d8-799e-46fa-888f-6dcae4d9528a service nova] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 643.182700] env[66123]: INFO networking_nsxv3.common.synchronization [req-a3d36c2b-fec4-464b-af6e-50115107bc41 req-5e6086d8-799e-46fa-888f-6dcae4d9528a service nova] Enqueued Resource ID: a71f285d-84fa-4910-b7a8-8db5106f6d90 with Priority: HIGHEST for action port [ 643.183430] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_rules [ 643.183430] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 643.183430] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a71f285d-84fa-4910-b7a8-8db5106f6d90 with Priority: HIGHEST for action port [ 643.183812] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.183928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.183995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.184355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.184439] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.185660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.186052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.186273] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a71f285d-84fa-4910-b7a8-8db5106f6d90 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.186399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.186434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.186636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.186694] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a71f285d-84fa-4910-b7a8-8db5106f6d90',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.212971] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.213448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.213548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.213796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.213986] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.214109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.214174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.214603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.214603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.214603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.214775] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.214832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.214874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.215029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.215182] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.215282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.215342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.215508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.215587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.215681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.215777] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.324135] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1f06e054-43f7-4778-9933-89341e69c01d tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 643.324862] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 643.325470] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.325650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.325714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.325988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.326084] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.513774] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.513965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.514041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.514256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.514347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.514455] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 643.518844] env[66123]: INFO networking_nsxv3.common.synchronization [None req-4e9ac6eb-866d-4511-8a21-118f55970baa tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 643.518844] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 643.519269] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.519331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.547223] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.547405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.547673] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.547783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.547976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.558876] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 643.686857] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.687028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.688692] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a71f285d-84fa-4910-b7a8-8db5106f6d90 with status ACTIVE [ 643.688692] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.688951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.688951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.689472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.690608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.690854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.690994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.691073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.691268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.691393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.691548] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.691642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.691714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.691859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.691978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.692078] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a71f285d-84fa-4910-b7a8-8db5106f6d90 is going to be updated. [ 643.721740] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34c25001-52de-43e0-a917-8228366264a0: rpc.has_security_group_logging(os_id): False [ 643.725214] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.725392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.725442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.725698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.725856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.726043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a71f285d-84fa-4910-b7a8-8db5106f6d90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.748220] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.748220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.748220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.748408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.748513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.748790] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.748951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.749060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.749255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.749339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.749616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.749789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.749865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.751740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.752350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.752350] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.752632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.753279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.753495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.753619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.753726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be updated. [ 643.862032] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.865024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.865024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.865024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.865024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.866140] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.866498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.866732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.868247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.868486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.868768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 already deleted. [ 643.868994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.870131] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.871084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.871084] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.883353] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: IN_PROGRESS for 2s [ 643.977443] env[66123]: INFO networking_nsxv3.common.synchronization [req-f52fcb57-54dd-45d6-bc40-e0b070d2512b req-2cb0ecca-1cc4-4fd5-899f-44bc11581ec0 tempest-TenantUsagesTestJSON-1842817518 tempest-TenantUsagesTestJSON-1842817518-project-member] Enqueued Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_members [ 643.979305] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGHEST for action security_group_members [ 643.979732] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.980019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.980182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.981036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.981352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.981569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.981707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.982027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.982181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.982374] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.374040] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acae7498-6eb9-4817-9d61-924a64d54580 in Status: SUCCESS [ 644.374547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.375469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.375721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.376121] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.376121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.376446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.376446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.376446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.377476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.377476] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.400603] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.400603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.400603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.400603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.400603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.400603] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 already deleted. [ 644.400603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.489710] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.489710] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.489710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.489710] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d is going to be updated. [ 644.530451] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.530451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.530451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.530673] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.531097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.547415] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d in Status: IN_PROGRESS for 2s [ 644.879489] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.879945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.880135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.880500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.880752] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.880889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.880950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.881245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.881303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.881375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.881548] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.881645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.881700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.881851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.882016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.882108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.882167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.882330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.882496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.882625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.882669] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.952355] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: SUCCESS [ 644.952654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.952985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.953329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.953639] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.953780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.953929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.954087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.954241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.954353] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.388359] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acae7498-6eb9-4817-9d61-924a64d54580: rpc.has_security_group_logging(os_id): False [ 645.431293] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.431293] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.431293] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.431293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.432961] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.433295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.433455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.435278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.435278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.435278] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acae7498-6eb9-4817-9d61-924a64d54580 is going to be created. [ 645.457723] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.497357] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.497537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.497586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.497846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.498088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.512315] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acae7498-6eb9-4817-9d61-924a64d54580 in Status: IN_PROGRESS for 2s [ 645.571094] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 645.571446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.572222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.572493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.572681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.572800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.572863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.573041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.573123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.573214] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.900357] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: SUCCESS [ 645.900357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.961804] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.076392] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.076559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.076633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.076897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.076954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.077168] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.077331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.077413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.077575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.077658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.077753] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 646.096044] env[66123]: INFO networking_nsxv3.common.synchronization [req-e997a173-2053-45b8-a6f6-10ef3b418228 req-fa9b4b9b-fd66-49c3-8bf2-1877d461f867 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_members [ 646.096570] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_members [ 646.096875] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.097025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.097096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.097334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.097490] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.097593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.097656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.097797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.097879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.097985] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.108933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.109107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.109107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.109299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.109440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.119727] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 646.464549] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.464549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.464549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.464549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.464549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.464549] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be updated. [ 646.494655] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.495650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.495650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.495650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.497913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.501919] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.502555] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.502901] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.503362] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.503918] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.507319] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.507319] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.507319] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.507319] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.507319] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.507319] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.507319] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.507319] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.507319] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.507319] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.507319] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.507995] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: IN_PROGRESS for 2s [ 646.525406] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.525577] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.525715] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.525887] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.526212] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-524bc08e-3070-4638-b177-969e89860253 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.526379] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.526529] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.526808] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.526945] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('524bc08e-3070-4638-b177-969e89860253',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.562547] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d in Status: SUCCESS [ 646.562761] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d deletion is rescheduled due to dependency. [ 646.562881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.603214] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.603214] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.603214] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c already deleted. [ 646.603214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.031218] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.031218] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.031218] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.031492] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.031648] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.031799] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 524bc08e-3070-4638-b177-969e89860253 not found, creating... [ 647.032108] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.032270] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.032496] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.032746] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.032887] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.033188] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.033337] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.033496] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.033724] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.033856] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.034029] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 524bc08e-3070-4638-b177-969e89860253 is going to be created. [ 647.056641] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.056858] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.056979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.057294] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.057548] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.057784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.534618] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acae7498-6eb9-4817-9d61-924a64d54580 in Status: SUCCESS [ 647.534618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.877986] env[66123]: INFO networking_nsxv3.common.synchronization [req-e997a173-2053-45b8-a6f6-10ef3b418228 req-df7a0155-eb57-4a11-bf16-e594cd044fa2 service nova] Enqueued Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_rules [ 647.878183] env[66123]: INFO networking_nsxv3.common.synchronization [req-e997a173-2053-45b8-a6f6-10ef3b418228 req-df7a0155-eb57-4a11-bf16-e594cd044fa2 service nova] Enqueued Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_members [ 647.878391] env[66123]: INFO networking_nsxv3.common.synchronization [req-e997a173-2053-45b8-a6f6-10ef3b418228 req-df7a0155-eb57-4a11-bf16-e594cd044fa2 service nova] Enqueued Resource ID: 524bc08e-3070-4638-b177-969e89860253 with Priority: HIGHEST for action port [ 647.879071] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_rules [ 647.879256] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_members [ 647.879409] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 524bc08e-3070-4638-b177-969e89860253 with Priority: HIGHEST for action port [ 647.879812] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.879955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.880069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.880407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.880527] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.881629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.881784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.881883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.882134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.882348] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.882540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.882629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.882842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.882967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.883157] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.884127] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-524bc08e-3070-4638-b177-969e89860253 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.884442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.884442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.884556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.884668] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('524bc08e-3070-4638-b177-969e89860253',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.131085] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 648.131435] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 deletion is rescheduled due to dependency. [ 648.131435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.131626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.134152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.134152] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.134152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.134152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.134152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.134152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.134152] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.387560] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.388321] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.388427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.388877] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 524bc08e-3070-4638-b177-969e89860253 with status ACTIVE [ 648.389166] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.389339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.389436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.389726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.389901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.390189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.390377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.390473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.390673] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.390772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.390965] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.391115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.391177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.391298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.391433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.391466] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 524bc08e-3070-4638-b177-969e89860253 is going to be updated. [ 648.414195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.414712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.415016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.415360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.416752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.416752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-524bc08e-3070-4638-b177-969e89860253" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.521416] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: SUCCESS [ 648.521971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.522365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.522830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.523157] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.523453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.523641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.524658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.524658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.524658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.524658] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.569094] env[66123]: INFO networking_nsxv3.common.synchronization [req-ecc926bb-2c2e-4fa0-8987-bb197dc6431f req-d74e0049-9e6f-4577-8c10-f1fa8f39cbbb tempest-ServerExternalEventsTest-431103569 tempest-ServerExternalEventsTest-431103569-project-member] Enqueued Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_members [ 648.569094] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_members [ 648.569094] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7021f924-400e-4d63-ac79-b87e4a1fc7d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.569094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.569094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.569094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.569094] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.569094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.569094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.569609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.569609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.569609] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.638666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.640383] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.640383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.640383] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 648.670421] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.670742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.670742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.670969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.671146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.684162] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 648.889702] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.935986] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.935986] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.935986] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.936283] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.936495] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.936671] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.936748] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.936959] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.941061] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.941061] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.941061] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.941061] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.941061] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.941061] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.941061] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.941061] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.970688] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.970880] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.971061] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.971507] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.971816] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.972039] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.972160] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.973184] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.973184] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.027256] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.027534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.027616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.027937] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.028106] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.028277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.028336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.028549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.028650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.028746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.028933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.029045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.029117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.029288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.029445] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.029592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.029644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.029796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.029875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.029959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.030150] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.073718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.073921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.073969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.074181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.074275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.074609] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.074725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.074791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.074963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.075099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.075190] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 already deleted. [ 649.075290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.394334] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.394334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.394334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.395363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.395363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.395363] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c is going to be created. [ 649.426481] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.426857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.426857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.427273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.427273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.440664] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c in Status: UNINITIALIZED for 2s [ 649.475480] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.475631] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.475746] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.476029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.476390] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.476390] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf not found, creating... [ 649.476731] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.476805] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.476885] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.477497] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.477497] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.477744] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.478228] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.478228] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.478228] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.478614] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.478614] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf is going to be created. [ 649.511569] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.511844] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.512277] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.512364] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.512684] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.513025] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.532928] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb8f4e60-4319-40b5-a8f3-20680c5bcb74: rpc.has_security_group_logging(os_id): False [ 649.559511] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.559744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.559744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.559968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.560068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.560330] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.560415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.560459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.560618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.560696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.560875] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.560969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.561042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.561210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.561311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.561465] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.561621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.561621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.561724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.561796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.561877] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be updated. [ 649.676054] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.676228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.676331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.676597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.676754] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.695160] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: IN_PROGRESS for 2s [ 650.321359] env[66123]: INFO networking_nsxv3.common.synchronization [req-ecc926bb-2c2e-4fa0-8987-bb197dc6431f req-764293df-3240-4690-aa4f-592c9bdefcfc service nova] Enqueued Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_rules [ 650.321505] env[66123]: INFO networking_nsxv3.common.synchronization [req-ecc926bb-2c2e-4fa0-8987-bb197dc6431f req-764293df-3240-4690-aa4f-592c9bdefcfc service nova] Enqueued Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_members [ 650.321639] env[66123]: INFO networking_nsxv3.common.synchronization [req-ecc926bb-2c2e-4fa0-8987-bb197dc6431f req-764293df-3240-4690-aa4f-592c9bdefcfc service nova] Enqueued Resource ID: 3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf with Priority: HIGHEST for action port [ 650.322330] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_rules [ 650.323043] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_members [ 650.323043] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf with Priority: HIGHEST for action port [ 650.325712] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7021f924-400e-4d63-ac79-b87e4a1fc7d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.325874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.325958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.326637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.326637] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.327594] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7021f924-400e-4d63-ac79-b87e4a1fc7d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.328739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.328739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.328979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.329187] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.329664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.329664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.329664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.329664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.330507] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.331629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.331629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.331629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.331918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.331981] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.696370] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 650.697418] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 deletion is rescheduled due to dependency. [ 650.698165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.755935] env[66123]: INFO networking_nsxv3.common.synchronization [req-24c1898c-a85d-415f-baa7-a96695bc269e req-7af51ee3-2eca-40d0-be82-4720377bd185 tempest-ServersNegativeTestMultiTenantJSON-742028279 tempest-ServersNegativeTestMultiTenantJSON-742028279-project-member] Enqueued Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_members [ 650.755935] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGHEST for action security_group_members [ 650.757592] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.757790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.757843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.758096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.758305] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.758605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.758605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.758725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.758786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.758874] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.834809] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7021f924-400e-4d63-ac79-b87e4a1fc7d7 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.834809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.841296] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf with status ACTIVE [ 650.841296] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.841296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.841296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.841296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.841296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.841660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.841800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.841874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.842072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.842151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.842343] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.842438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.842507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.842664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.842759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.842814] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf is going to be updated. [ 650.845047] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.867912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.868119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.868223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.868523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.868653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.868913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b17a1e7-5b86-4ef8-8f03-617de1dd9fcf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.261751] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.261945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.262042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.262299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.262390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.262661] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.263090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.263090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.263090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.263090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.264231] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 is going to be updated. [ 651.302704] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.302889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.302939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.303141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.303284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.314375] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 in Status: IN_PROGRESS for 2s [ 651.347051] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.452773] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c in Status: SUCCESS [ 651.452773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.452773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.452773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.452987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.453110] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.453212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.453330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.453407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.453534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.453627] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.708545] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: SUCCESS [ 651.708852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.850244] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.850411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.850496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.851276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.851276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.851276] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 is going to be created. [ 651.874380] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.874534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.874603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.874845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.875028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.884932] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 in Status: UNINITIALIZED for 2s [ 651.957750] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.460398] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d63eb4-28c8-48e7-a18d-645e4eea8c5c: rpc.has_security_group_logging(os_id): False [ 652.495031] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.495234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.495335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.495679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.495732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.496054] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.496203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.496272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.496488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.496579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.496673] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c is going to be created. [ 652.580229] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.580229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.580229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.580229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.580229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.593077] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c in Status: IN_PROGRESS for 2s [ 653.097046] env[66123]: INFO networking_nsxv3.common.synchronization [req-952bb16c-1312-443d-ba1a-23af25f788b6 req-f5f993c1-46b9-48f1-8c5f-a0544d81bc75 tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 653.097789] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 653.098149] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.098279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.098362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.098606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.098697] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.098796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.098966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.099044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.099100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.099188] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.326346] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 in Status: SUCCESS [ 653.326533] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 deletion is rescheduled due to dependency. [ 653.326646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.602402] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.638412] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.638573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.638619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.638914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.639149] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.639332] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.639416] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.639635] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.639775] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.639968] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.640587] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.640760] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.640887] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.641069] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.641209] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.641364] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.664563] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.664563] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.664563] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.664563] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.664563] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-f1f94892-a313-4151-b093-385cf6a4062a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.664563] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.664938] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.665238] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.665358] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1f94892-a313-4151-b093-385cf6a4062a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.895195] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 in Status: SUCCESS [ 653.895427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.895599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.895840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.896081] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.896239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.896368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.896602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.896751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.896883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.897054] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.107009] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.169393] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.169393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.169393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.169679] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.169816] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.169965] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port f1f94892-a313-4151-b093-385cf6a4062a not found, creating... [ 654.170270] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.170433] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.170507] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.170744] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.171182] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.171182] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.171332] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.171468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.171607] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.171748] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.171860] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: f1f94892-a313-4151-b093-385cf6a4062a is going to be created. [ 654.194438] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.194686] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.194864] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.195160] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.195391] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.195619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.401036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7021f924-400e-4d63-ac79-b87e4a1fc7d7 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.401036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.401036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.401036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.401975] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.401975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.401975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.401975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.401975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.401975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.401975] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7021f924-400e-4d63-ac79-b87e4a1fc7d7 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.402309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.402309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.402309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.403180] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.403180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.403180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.403180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.403180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.403180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.403444] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.607848] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c in Status: SUCCESS [ 654.608113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.609209] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.609209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.609209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.609209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.609209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.609209] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 654.644988] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.645364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.645364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.645981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.646625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.660518] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 654.906779] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7021f924-400e-4d63-ac79-b87e4a1fc7d7: rpc.has_security_group_logging(os_id): False [ 654.925920] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.925920] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.925920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.926589] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.926589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.926589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.926589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.926589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.926896] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.928255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.928255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.928255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.928255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.928255] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 is going to be created. [ 654.992839] env[66123]: INFO networking_nsxv3.common.synchronization [req-952bb16c-1312-443d-ba1a-23af25f788b6 req-671b5ec4-ab59-43af-aa7d-72939c1bac9b service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 654.993224] env[66123]: INFO networking_nsxv3.common.synchronization [req-952bb16c-1312-443d-ba1a-23af25f788b6 req-671b5ec4-ab59-43af-aa7d-72939c1bac9b service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 654.993447] env[66123]: INFO networking_nsxv3.common.synchronization [req-952bb16c-1312-443d-ba1a-23af25f788b6 req-671b5ec4-ab59-43af-aa7d-72939c1bac9b service nova] Enqueued Resource ID: f1f94892-a313-4151-b093-385cf6a4062a with Priority: HIGHEST for action port [ 654.994751] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 654.994751] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 654.994751] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1f94892-a313-4151-b093-385cf6a4062a with Priority: HIGHEST for action port [ 654.994941] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.995049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.995297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.995400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.995511] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.996915] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.996915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.996915] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1f94892-a313-4151-b093-385cf6a4062a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.996915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.996915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.997183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.997217] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1f94892-a313-4151-b093-385cf6a4062a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.999324] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.999401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.003047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.003047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.003047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.012512] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 in Status: IN_PROGRESS for 2s [ 655.499571] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.500733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.502080] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1f94892-a313-4151-b093-385cf6a4062a with status ACTIVE [ 655.502268] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.502447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.502569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.502858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.502927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.503141] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.503245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.503308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.503518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.503703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.503773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.503891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.504108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.504108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.504216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.504279] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1f94892-a313-4151-b093-385cf6a4062a is going to be updated. [ 655.536646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.536837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.536837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.537116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.537283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.537470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1f94892-a313-4151-b093-385cf6a4062a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.183166] env[66123]: INFO networking_nsxv3.common.synchronization [req-b4c071d9-9ff4-46bb-a7f2-3ddb04b178c8 req-994b203d-9efa-4cad-84cf-b8ce0f480f31 tempest-FloatingIPsAssociationNegativeTestJSON-1887836827 tempest-FloatingIPsAssociationNegativeTestJSON-1887836827-project-member] Enqueued Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_members [ 656.183166] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_members [ 656.183166] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.183166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.183166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.183374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.183924] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.183924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.183924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.183924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.183924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.184177] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.666893] env[66123]: INFO networking_nsxv3.common.synchronization [None req-3bc17e15-145c-4c3b-a119-db5aa288baaf None None] Enqueued Resource ID: fe09c581-e0cf-4452-ad80-002bb4cd4adb with Priority: HIGHEST for action port [ 656.667617] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe09c581-e0cf-4452-ad80-002bb4cd4adb with Priority: HIGHEST for action port [ 656.668542] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe09c581-e0cf-4452-ad80-002bb4cd4adb taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.668801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe09c581-e0cf-4452-ad80-002bb4cd4adb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.668801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe09c581-e0cf-4452-ad80-002bb4cd4adb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.669094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe09c581-e0cf-4452-ad80-002bb4cd4adb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.669136] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe09c581-e0cf-4452-ad80-002bb4cd4adb',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.677780] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 656.678136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.678847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.678847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.679026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.679231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.679346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.679625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.679780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.679942] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.689670] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.689841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.689923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.690361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.690469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.690721] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.690965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.690965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.691190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.691286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.692070] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 already deleted. [ 656.692217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.027403] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 in Status: SUCCESS [ 657.027816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.168173] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.168370] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-52" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.168489] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-52" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.168857] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-52" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.169151] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.169310] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.169421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.169639] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.169778] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.169972] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.170758] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.170758] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.170758] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.171016] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.171016] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.171113] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.173281] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe09c581-e0cf-4452-ad80-002bb4cd4adb [ 657.173281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.173281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.173281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.173281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.173281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.173281] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe09c581-e0cf-4452-ad80-002bb4cd4adb already deleted. [ 657.173281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe09c581-e0cf-4452-ad80-002bb4cd4adb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.183865] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.193186] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.193370] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.193532] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.193734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-52" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.194059] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.194230] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.194342] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.194661] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.194809] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acfa6fbc-2681-4492-a5f6-ee4dd0a116d4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.687660] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.697336] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.697595] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.697670] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.698434] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.698434] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.698434] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 not found, creating... [ 657.698959] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.698959] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.698959] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.698959] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.699173] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.699345] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.699475] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.699587] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.699784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.699910] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.700053] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 is going to be created. [ 657.724953] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.724953] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.724953] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.725241] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.725462] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.726096] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.191013] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.191013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.191013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.191239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.191239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.191302] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 658.223379] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.223537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.223597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.223856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.224024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.233630] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 658.435813] env[66123]: INFO networking_nsxv3.common.synchronization [req-b4c071d9-9ff4-46bb-a7f2-3ddb04b178c8 req-aa63537d-5885-4786-8d01-069f6e988957 service nova] Enqueued Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_rules [ 658.435989] env[66123]: INFO networking_nsxv3.common.synchronization [req-b4c071d9-9ff4-46bb-a7f2-3ddb04b178c8 req-aa63537d-5885-4786-8d01-069f6e988957 service nova] Enqueued Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_members [ 658.436133] env[66123]: INFO networking_nsxv3.common.synchronization [req-b4c071d9-9ff4-46bb-a7f2-3ddb04b178c8 req-aa63537d-5885-4786-8d01-069f6e988957 service nova] Enqueued Resource ID: acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 with Priority: HIGHEST for action port [ 658.436354] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_rules [ 658.436484] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_members [ 658.436581] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 with Priority: HIGHEST for action port [ 658.437567] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.437700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.437771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.438042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.438127] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.439691] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.439799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.439864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.440049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.440197] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.440585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.440625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.440750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.440840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.440928] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.441667] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.442647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.442647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.442647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.442647] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acfa6fbc-2681-4492-a5f6-ee4dd0a116d4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.690244] env[66123]: INFO networking_nsxv3.common.synchronization [None req-b080d06d-13be-4420-bf7b-6bddea58e715 None None] Enqueued Resource ID: e02836a2-a9ad-4018-b51e-6fdca1e7c5f1 with Priority: HIGHEST for action port [ 658.691259] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02836a2-a9ad-4018-b51e-6fdca1e7c5f1 with Priority: HIGHEST for action port [ 658.691948] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e02836a2-a9ad-4018-b51e-6fdca1e7c5f1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.691948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e02836a2-a9ad-4018-b51e-6fdca1e7c5f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.691948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e02836a2-a9ad-4018-b51e-6fdca1e7c5f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.691948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e02836a2-a9ad-4018-b51e-6fdca1e7c5f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.692202] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e02836a2-a9ad-4018-b51e-6fdca1e7c5f1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.945126] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.947165] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.949123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.949123] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 with status ACTIVE [ 658.949317] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.950046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.950046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.950046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.950046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.950046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.950287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.950627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.950627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.950627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.950830] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.950964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.951062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.951237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.951348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.951466] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acfa6fbc-2681-4492-a5f6-ee4dd0a116d4 is going to be updated. [ 658.983941] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.984115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.984189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.984399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.984535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.984695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acfa6fbc-2681-4492-a5f6-ee4dd0a116d4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.194908] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e02836a2-a9ad-4018-b51e-6fdca1e7c5f1 [ 659.195162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.195299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.195367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.195592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.195691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.195782] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e02836a2-a9ad-4018-b51e-6fdca1e7c5f1 already deleted. [ 659.195863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e02836a2-a9ad-4018-b51e-6fdca1e7c5f1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.451701] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.956568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.956901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.956901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.956901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.957132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.957132] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 is going to be created. [ 659.983900] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.984365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.984443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.984662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.984824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.996603] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 in Status: UNINITIALIZED for 2s [ 660.243894] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 660.245023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.245236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.245458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.245654] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.245773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.246077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.246077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.246077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.246227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.246273] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.339481] env[66123]: INFO networking_nsxv3.common.synchronization [None req-4da3b7b0-0622-4bec-a154-fc69e3c374d9 None None] Enqueued Resource ID: 2b554e99-3039-48c1-aaaf-a431a3c41ba2 with Priority: HIGHEST for action port [ 660.340822] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b554e99-3039-48c1-aaaf-a431a3c41ba2 with Priority: HIGHEST for action port [ 660.341923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b554e99-3039-48c1-aaaf-a431a3c41ba2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.342655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b554e99-3039-48c1-aaaf-a431a3c41ba2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.342655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b554e99-3039-48c1-aaaf-a431a3c41ba2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.342766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b554e99-3039-48c1-aaaf-a431a3c41ba2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.342964] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b554e99-3039-48c1-aaaf-a431a3c41ba2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.749016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.749224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.749270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.749491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.751269] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.751412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.751480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.751678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.751783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.751886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.752499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.752499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.752499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.752499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.752499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.752798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.752798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.755851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.755965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.756865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.756865] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.847805] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b554e99-3039-48c1-aaaf-a431a3c41ba2 [ 660.847805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.847805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.847805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.847805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.847805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.847805] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b554e99-3039-48c1-aaaf-a431a3c41ba2 already deleted. [ 660.847805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b554e99-3039-48c1-aaaf-a431a3c41ba2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.259042] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3b19fe3-562d-4163-b8e0-7d5f0c6475ed: rpc.has_security_group_logging(os_id): False [ 661.284020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.284408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.285486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.285940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.286163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.286578] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.286716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.286990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.286990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.287198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.287528] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.287683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.287758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.287961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.288301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.288401] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.288568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.288809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.289042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.289161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.289314] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 661.374181] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.374181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.374181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.374181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.374181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.390377] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 662.007274] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 in Status: SUCCESS [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.011056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.011056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.011056] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.514180] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.514180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.514180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.514180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.514619] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.514619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.514619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.515050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.515150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.515383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.515507] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.515903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.515993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.516194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.516383] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.516508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.516593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.516768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.516880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.516999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.517156] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.564991] env[66123]: INFO networking_nsxv3.common.synchronization [req-848caa6f-3625-4e2a-afd4-d0369860d674 req-f16317ad-06a6-49d0-a171-1b075227b580 tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 662.565584] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 662.565894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.566200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.566318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.566636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.566843] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.566983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.567249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.567249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.567384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.567499] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.990153] env[66123]: INFO networking_nsxv3.common.synchronization [None req-351dc3d1-3b6c-4966-abfa-67e13ce39465 None None] Enqueued Resource ID: 77b7a05b-e78c-4286-962c-2b0786bd55d3 with Priority: HIGHEST for action port [ 662.990731] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b7a05b-e78c-4286-962c-2b0786bd55d3 with Priority: HIGHEST for action port [ 662.991108] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-77b7a05b-e78c-4286-962c-2b0786bd55d3 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.991239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77b7a05b-e78c-4286-962c-2b0786bd55d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.991310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77b7a05b-e78c-4286-962c-2b0786bd55d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.991571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77b7a05b-e78c-4286-962c-2b0786bd55d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.991746] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b7a05b-e78c-4286-962c-2b0786bd55d3',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.019263] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2336a996-6f79-4ed3-957d-c1cac2fff362: rpc.has_security_group_logging(os_id): False [ 663.040980] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.041145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.041208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.041526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.041526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.041839] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.041945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.042014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.042239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.042239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.042439] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.042534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.042658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.042796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.042873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.043354] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.043511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.043749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.043749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.043884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.043884] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 is going to be created. [ 663.070379] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.070749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.070749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.071109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.071209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.071431] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.071532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.071598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.071765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.071845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.071931] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 already deleted. [ 663.072033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.102009] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.102176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.102254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.102518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.102713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.116605] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 in Status: IN_PROGRESS for 2s [ 663.409328] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 663.409649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.493596] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77b7a05b-e78c-4286-962c-2b0786bd55d3 [ 663.493876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.494030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.494240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.494324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.494464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.494525] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77b7a05b-e78c-4286-962c-2b0786bd55d3 already deleted. [ 663.494580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77b7a05b-e78c-4286-962c-2b0786bd55d3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.571611] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.571922] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.571922] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.572282] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.574251] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.574422] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.574538] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.574761] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.574925] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.576729] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.576729] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.576729] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.576729] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.576729] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.576729] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.576729] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.596906] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.596906] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.596906] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.596906] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.596906] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.597208] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.597325] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.598128] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.598128] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cff2bfb-bf8b-40f4-9bdb-4ed875735f03',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.101705] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.102179] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.102179] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.102331] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.102472] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.103147] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 not found, creating... [ 664.103147] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.103147] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.103354] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.103393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.103513] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.103810] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.103957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.104103] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.104377] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.104442] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.104514] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 is going to be created. [ 664.124781] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.124984] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.125212] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.125485] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.125706] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.125919] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.233293] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ab22827-0a72-4f2c-859b-b8635976e12d req-72d62edf-3b17-4e3a-be7b-a167bf29bd1b tempest-DeleteServersAdminTestJSON-1729712883 tempest-DeleteServersAdminTestJSON-1729712883-project-member] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 664.234182] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGHEST for action security_group_members [ 664.234275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.234402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.234470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.235028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.235028] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.235028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.235028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.235345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.235345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.235345] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.738052] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.738497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.738497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.738606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.738606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.738821] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.738919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.738966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.739153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.739293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.739352] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be updated. [ 664.769697] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.771920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.771920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.771920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.771920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.781448] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: IN_PROGRESS for 2s [ 664.940917] env[66123]: INFO networking_nsxv3.common.synchronization [req-848caa6f-3625-4e2a-afd4-d0369860d674 req-2e7d6cdc-25b5-4f55-9dfd-eff0b5c629a1 service nova] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 664.941080] env[66123]: INFO networking_nsxv3.common.synchronization [req-848caa6f-3625-4e2a-afd4-d0369860d674 req-2e7d6cdc-25b5-4f55-9dfd-eff0b5c629a1 service nova] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 664.941487] env[66123]: INFO networking_nsxv3.common.synchronization [req-848caa6f-3625-4e2a-afd4-d0369860d674 req-2e7d6cdc-25b5-4f55-9dfd-eff0b5c629a1 service nova] Enqueued Resource ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 with Priority: HIGHEST for action port [ 664.942288] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 664.942391] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 664.943346] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 with Priority: HIGHEST for action port [ 664.943346] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.943346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.943346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.943346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.943602] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.948467] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.949097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.949097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.950263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.950263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.950263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.950263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.950263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.950263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.950505] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.953886] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.954109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.954168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.954724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.954945] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cff2bfb-bf8b-40f4-9bdb-4ed875735f03',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.137565] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 in Status: SUCCESS [ 665.137565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.454360] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.457558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 with status ACTIVE [ 665.457792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.457930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.457995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.458228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.458316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.458504] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.458604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.458664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.458838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.458917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.459111] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.459239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.459275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.459394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.459465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.459546] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 is going to be updated. [ 665.461922] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.462046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.482443] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.482660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.482717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.482906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.483054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.483218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.962764] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.350209] env[66123]: INFO networking_nsxv3.common.synchronization [req-c60a1d8f-788f-4ebb-ab9c-68ce4cbf7a51 req-72c86ae2-0104-40c5-a5d0-bc9d95c81e6e tempest-ServerGroupTestJSON-1329710432 tempest-ServerGroupTestJSON-1329710432-project-member] Enqueued Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_members [ 666.350822] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_members [ 666.351139] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.351279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.351345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.351628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.351737] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.351825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.351872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.352270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.352270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.352270] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.468536] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.468783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.468959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.469142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.469367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.469469] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 is going to be created. [ 666.496298] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.499019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.499019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.499019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.499019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.507726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: UNINITIALIZED for 2s [ 666.796025] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c25001-52de-43e0-a917-8228366264a0 in Status: SUCCESS [ 666.796025] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c25001-52de-43e0-a917-8228366264a0 deletion is rescheduled due to dependency. [ 666.796025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.859025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.859025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.859025] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 already deleted. [ 666.859025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.860391] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.860835] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-125" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.861155] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-125" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.861615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-125" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.864031] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.864031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.864031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.864031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.864031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.864031] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.864031] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.864031] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.864031] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.864031] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.864031] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.864031] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.924421] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.924421] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.060 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.924421] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.924421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-125" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.924421] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-03eb4228-7318-488d-adee-6ceb903e219a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.924836] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.924836] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.925795] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.925795] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03eb4228-7318-488d-adee-6ceb903e219a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.429968] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.430979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.430979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.431210] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.431449] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.431650] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 03eb4228-7318-488d-adee-6ceb903e219a not found, creating... [ 667.431917] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.432089] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.432200] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.432543] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.432698] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.433016] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.433163] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.433267] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.433467] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.433755] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.433755] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 03eb4228-7318-488d-adee-6ceb903e219a is going to be created. [ 667.477326] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.477555] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.477673] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.478403] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.478403] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.478403] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.776495] env[66123]: INFO networking_nsxv3.common.synchronization [None req-817139cd-f3c5-4eaa-b2e2-8d7b43215e70 None None] Enqueued Resource ID: 0021c175-8ad1-460e-9b25-d727c8d30d3d with Priority: HIGHEST for action port [ 667.776495] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021c175-8ad1-460e-9b25-d727c8d30d3d with Priority: HIGHEST for action port [ 667.776495] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-0021c175-8ad1-460e-9b25-d727c8d30d3d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.776495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0021c175-8ad1-460e-9b25-d727c8d30d3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.777573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0021c175-8ad1-460e-9b25-d727c8d30d3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.778026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0021c175-8ad1-460e-9b25-d727c8d30d3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.779109] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0021c175-8ad1-460e-9b25-d727c8d30d3d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.139798] env[66123]: INFO networking_nsxv3.common.synchronization [req-c60a1d8f-788f-4ebb-ab9c-68ce4cbf7a51 req-15ceec7e-cd9e-433e-9293-2bde35117d3b service nova] Enqueued Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_rules [ 668.139798] env[66123]: INFO networking_nsxv3.common.synchronization [req-c60a1d8f-788f-4ebb-ab9c-68ce4cbf7a51 req-15ceec7e-cd9e-433e-9293-2bde35117d3b service nova] Enqueued Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_members [ 668.139798] env[66123]: INFO networking_nsxv3.common.synchronization [req-c60a1d8f-788f-4ebb-ab9c-68ce4cbf7a51 req-15ceec7e-cd9e-433e-9293-2bde35117d3b service nova] Enqueued Resource ID: 03eb4228-7318-488d-adee-6ceb903e219a with Priority: HIGHEST for action port [ 668.140158] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_rules [ 668.141174] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_members [ 668.141338] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03eb4228-7318-488d-adee-6ceb903e219a with Priority: HIGHEST for action port [ 668.141644] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.141772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.141832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.142117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.142189] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.144772] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.144838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.144918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.145141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.145307] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.145409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.145471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.145632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.145717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.145812] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.154091] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-03eb4228-7318-488d-adee-6ceb903e219a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.154091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.154091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.154091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.154091] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03eb4228-7318-488d-adee-6ceb903e219a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.282915] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0021c175-8ad1-460e-9b25-d727c8d30d3d [ 668.283395] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.283395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.283395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.283722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.283991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.283991] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0021c175-8ad1-460e-9b25-d727c8d30d3d already deleted. [ 668.284165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0021c175-8ad1-460e-9b25-d727c8d30d3d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.521008] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: SUCCESS [ 668.521662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.521662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.521662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.524140] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.524140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.524140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.524140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.524140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.524140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.524140] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.568930] env[66123]: INFO networking_nsxv3.common.synchronization [req-108b1df7-efe2-4ae4-91fa-77130c4c1c62 req-fe279754-52e3-4a3f-8465-846f61ac9e8d tempest-VolumesAdminNegativeTest-530114969 tempest-VolumesAdminNegativeTest-530114969-project-member] Enqueued Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_members [ 668.569111] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGHEST for action security_group_members [ 668.569457] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.569594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.569668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.569840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.569988] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.570097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.570154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.570304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.570444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.570532] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.651935] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.654933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.654933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.655251] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03eb4228-7318-488d-adee-6ceb903e219a with status ACTIVE [ 668.655334] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.655538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.655634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.655977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.656126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.656681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.656681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.656681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.657049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.657049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.657304] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.657439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.657439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.658033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.658033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.658033] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03eb4228-7318-488d-adee-6ceb903e219a is going to be updated. [ 668.671785] env[66123]: INFO networking_nsxv3.common.synchronization [req-b7b75027-696a-494c-a416-b73f488ba98d req-491192de-7e4c-40d1-b04d-66b445fa3e66 tempest-ServersAdminNegativeTestJSON-1257558661 tempest-ServersAdminNegativeTestJSON-1257558661-project-member] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 668.672581] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 668.672581] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.673166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.673166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.673166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.673379] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.673379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.673473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.673557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.673667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.673974] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.682177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.682321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.682411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.682567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.682736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.682895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03eb4228-7318-488d-adee-6ceb903e219a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.026244] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.050039] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.050039] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.050039] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.050039] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.050039] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.054028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.054193] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.054635] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.054704] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.055193] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.055279] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.055376] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.056336] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.056336] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.056336] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.056336] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.073920] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.073920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.073920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.073920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.073920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.074181] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.074231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.074345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.074623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.074756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.074905] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acae7498-6eb9-4817-9d61-924a64d54580 is going to be updated. [ 669.078369] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.078641] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.079709] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.079709] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.084027] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-e21618a5-cc19-436f-af75-c3978f879fce taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.084304] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.084499] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.084994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.085298] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e21618a5-cc19-436f-af75-c3978f879fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.130049] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.130049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.130049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.130049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.130049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.140406] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acae7498-6eb9-4817-9d61-924a64d54580 in Status: IN_PROGRESS for 2s [ 669.152950] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.179248] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.179454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.179499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.179770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.179950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.180112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.180220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.180286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.180446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.180544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.180640] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd already deleted. [ 669.180723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.528277] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f94438f-58b5-4c82-8302-4f45a58dee50: rpc.has_security_group_logging(os_id): False [ 669.552970] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.553165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.553211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.553414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.553505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.553749] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.553853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.553918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.554101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.554189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.554292] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 is going to be created. [ 669.588487] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.588881] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.588966] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.589312] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.589615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.589843] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port e21618a5-cc19-436f-af75-c3978f879fce not found, creating... [ 669.590064] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.590284] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.590452] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.590857] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.590985] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.591378] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.591631] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.591735] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.592079] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.592268] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.592446] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: e21618a5-cc19-436f-af75-c3978f879fce is going to be created. [ 669.616915] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.628664] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.628664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.654562] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: IN_PROGRESS for 2s [ 669.655292] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.655736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.655736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.655949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.656020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.656132] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 is going to be created. [ 669.732980] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.732980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.732980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.732980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.733642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.754846] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 in Status: UNINITIALIZED for 2s [ 670.054721] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7cb6b8b7-382d-49e2-b092-32671007fb0d None None] Enqueued Resource ID: 52210d40-c4ab-42c9-b339-f03603da9c3e with Priority: HIGHEST for action port [ 670.056062] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52210d40-c4ab-42c9-b339-f03603da9c3e with Priority: HIGHEST for action port [ 670.056498] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-52210d40-c4ab-42c9-b339-f03603da9c3e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.056498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52210d40-c4ab-42c9-b339-f03603da9c3e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.056498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52210d40-c4ab-42c9-b339-f03603da9c3e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.057012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52210d40-c4ab-42c9-b339-f03603da9c3e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.057012] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52210d40-c4ab-42c9-b339-f03603da9c3e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.349795] env[66123]: INFO networking_nsxv3.common.synchronization [req-b7b75027-696a-494c-a416-b73f488ba98d req-a248a986-505e-4a5a-9c4c-565bd1fdbe9f service nova] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_rules [ 670.349997] env[66123]: INFO networking_nsxv3.common.synchronization [req-b7b75027-696a-494c-a416-b73f488ba98d req-a248a986-505e-4a5a-9c4c-565bd1fdbe9f service nova] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 670.350148] env[66123]: INFO networking_nsxv3.common.synchronization [req-b7b75027-696a-494c-a416-b73f488ba98d req-a248a986-505e-4a5a-9c4c-565bd1fdbe9f service nova] Enqueued Resource ID: e21618a5-cc19-436f-af75-c3978f879fce with Priority: HIGHEST for action port [ 670.350703] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_rules [ 670.350849] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 670.350947] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21618a5-cc19-436f-af75-c3978f879fce with Priority: HIGHEST for action port [ 670.351423] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.351547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.351615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.351876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.351960] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.353655] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.353655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.353655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.353939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.354386] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.354500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.354564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.354722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.354835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.354899] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.356632] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e21618a5-cc19-436f-af75-c3978f879fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.356769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.356840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.356996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.357086] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e21618a5-cc19-436f-af75-c3978f879fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.559846] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52210d40-c4ab-42c9-b339-f03603da9c3e [ 670.561026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.561026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.561026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.561026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.561252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.561252] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52210d40-c4ab-42c9-b339-f03603da9c3e already deleted. [ 670.561252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52210d40-c4ab-42c9-b339-f03603da9c3e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.854470] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.854664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.857283] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.858420] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e21618a5-cc19-436f-af75-c3978f879fce with status ACTIVE [ 670.858798] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.858873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.858945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.859207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.859334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.860292] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.860292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.860292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.860292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.860292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.860559] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.860622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.861529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.861529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.861529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.861529] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e21618a5-cc19-436f-af75-c3978f879fce is going to be updated. [ 670.889173] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.889457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.889592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.890145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.890399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.890705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e21618a5-cc19-436f-af75-c3978f879fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.152157] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acae7498-6eb9-4817-9d61-924a64d54580 in Status: SUCCESS [ 671.152311] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acae7498-6eb9-4817-9d61-924a64d54580 deletion is rescheduled due to dependency. [ 671.152426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.363150] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.668277] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: SUCCESS [ 671.668643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.765979] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 in Status: SUCCESS [ 671.766306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.766534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.767125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.767125] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.767303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.767477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.767629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.767761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.767883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.768015] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.866772] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.866947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.867158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.867434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.867525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.867790] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd is going to be created. [ 671.901198] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.901355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.901426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.901678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.901849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.916965] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: UNINITIALIZED for 2s [ 672.271555] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.271555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.271555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.271907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.272126] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.272278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.272353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.272608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.272731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.272851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.273101] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.273210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.273275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.273449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.274041] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.274041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.274041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.274232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.274232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.274297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.274379] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.779495] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1957763-4da9-4aac-91d0-1bb35c3e6d74: rpc.has_security_group_logging(os_id): False [ 672.799715] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.802755] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.802755] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.802755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.803721] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.803721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.803721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.803721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.803721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.803721] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 is going to be created. [ 672.874157] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.874157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.874304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.874429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.874598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.890517] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 in Status: IN_PROGRESS for 2s [ 673.930571] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: SUCCESS [ 673.930895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.931121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.931726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.931972] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.932246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.932362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.932551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.932678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.932815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.933192] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.436434] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.436434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.436434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.436747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.436747] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.436835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.436926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.437190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.437319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.437444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.437646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.437748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.437846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.438056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.438263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.438387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.438473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.438669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.438772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.438889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.439560] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.505871] env[66123]: INFO networking_nsxv3.common.synchronization [None req-942e9d8a-38a9-4b0a-9c86-fa3d09034d2a None None] Enqueued Resource ID: d83c1360-ea72-4192-a554-eb42fa5608a6 with Priority: HIGHEST for action port [ 674.505871] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83c1360-ea72-4192-a554-eb42fa5608a6 with Priority: HIGHEST for action port [ 674.505871] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-d83c1360-ea72-4192-a554-eb42fa5608a6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.505871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d83c1360-ea72-4192-a554-eb42fa5608a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.505871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d83c1360-ea72-4192-a554-eb42fa5608a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.505871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d83c1360-ea72-4192-a554-eb42fa5608a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.505871] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83c1360-ea72-4192-a554-eb42fa5608a6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.908385] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 in Status: SUCCESS [ 674.908385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.941478] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc8e203a-a322-44a7-8e22-6a43e3c9abbd: rpc.has_security_group_logging(os_id): False [ 674.964551] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964551] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.964551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964551] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.966052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.966052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.966052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.966052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.966052] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.966052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.966401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.966401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.966401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.966491] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd is going to be created. [ 675.010518] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d83c1360-ea72-4192-a554-eb42fa5608a6 [ 675.010518] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.010518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.010518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.010518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.010518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.010518] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d83c1360-ea72-4192-a554-eb42fa5608a6 already deleted. [ 675.010518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d83c1360-ea72-4192-a554-eb42fa5608a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.040252] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.041261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.041261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.041470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.043449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.063340] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: IN_PROGRESS for 2s [ 677.085978] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: SUCCESS [ 677.086280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.261558] env[66123]: INFO networking_nsxv3.common.synchronization [None req-422d515d-0c2e-4716-8925-86cd95fc7b97 None None] Enqueued Resource ID: 8bfd9bd6-e797-4284-8aad-26afc5ef408c with Priority: HIGHEST for action port [ 677.262176] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bfd9bd6-e797-4284-8aad-26afc5ef408c with Priority: HIGHEST for action port [ 677.262503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bfd9bd6-e797-4284-8aad-26afc5ef408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.262621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bfd9bd6-e797-4284-8aad-26afc5ef408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.262713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bfd9bd6-e797-4284-8aad-26afc5ef408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.262985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bfd9bd6-e797-4284-8aad-26afc5ef408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.263138] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bfd9bd6-e797-4284-8aad-26afc5ef408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.765702] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bfd9bd6-e797-4284-8aad-26afc5ef408c [ 677.765995] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.766129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.766229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.766462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.766550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.766714] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bfd9bd6-e797-4284-8aad-26afc5ef408c already deleted. [ 677.766714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bfd9bd6-e797-4284-8aad-26afc5ef408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.832967] env[66123]: INFO networking_nsxv3.common.synchronization [req-904c3fb6-8153-46fa-b28b-fde852ccbd2a req-79399e51-9e2f-4d6c-8b85-e0818f343fe2 tempest-ServerExternalEventsTest-431103569 tempest-ServerExternalEventsTest-431103569-project-member] Enqueued Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_members [ 677.833439] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 with Priority: HIGHEST for action security_group_members [ 677.833796] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7021f924-400e-4d63-ac79-b87e4a1fc7d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.833935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.834801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.834801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.835084] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.835167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.835259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.838156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.838156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.838156] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7021f924-400e-4d63-ac79-b87e4a1fc7d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.339525] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.340024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.340024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.340169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.340169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.340375] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.340499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.340571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.340787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.340875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.340963] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 is going to be updated. [ 678.369524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.369810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.369810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.369938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.370104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.378992] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 in Status: IN_PROGRESS for 2s [ 679.328339] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-8d970fe3-6617-49d8-a765-4f059e0a332f tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 679.329634] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 679.330093] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.330281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.330359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.330684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.330901] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.331203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.331305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.331579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.331797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.331797] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.834132] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.834649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.834649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.834649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.834649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.834913] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.835031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.835096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.835224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.835301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.835390] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 679.862113] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.862275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.862365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.863447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.863447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.873885] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 679.875780] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-854f494d-6ef0-4ecc-83f2-07946f0b7d9c tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 679.876319] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 679.876613] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.876708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.389153] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 in Status: SUCCESS [ 680.389350] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7021f924-400e-4d63-ac79-b87e4a1fc7d7 deletion is rescheduled due to dependency. [ 680.389468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7021f924-400e-4d63-ac79-b87e4a1fc7d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.506401] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.506598] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-373" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.506718] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-373" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.507130] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-373" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.507342] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.507519] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.507631] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.507866] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.508060] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.508261] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.508418] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.508551] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.508729] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.508772] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.508849] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.508976] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.533021] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.533506] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.533558] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.534265] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-373" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.534265] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-1fb628f5-9a12-4243-8b91-67632c4c9291 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.534720] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.534888] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.535241] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.535378] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb628f5-9a12-4243-8b91-67632c4c9291',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.039939] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.040269] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.040269] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.040535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.040677] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.040820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 1fb628f5-9a12-4243-8b91-67632c4c9291 not found, creating... [ 681.041148] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.041334] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.041449] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.041721] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.041866] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.042160] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.042328] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.042411] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.042609] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.042754] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.042896] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 1fb628f5-9a12-4243-8b91-67632c4c9291 is going to be created. [ 681.066182] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.066182] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.066182] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.066788] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.067067] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.067280] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.822099] env[66123]: INFO networking_nsxv3.common.synchronization [req-b93adb62-b4b5-4769-884d-63a5f0d36ffd req-7eb4106a-8436-4047-825b-1b7343dd539a tempest-ServerTagsTestJSON-1794780608 tempest-ServerTagsTestJSON-1794780608-project-member] Enqueued Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_members [ 681.822670] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_members [ 681.823195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.823336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.823336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.823527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.823741] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.824182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.824273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.824429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.824523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.824611] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.846061] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-d0a1f37a-502d-40f4-820d-61148338e990 service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 681.846685] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-d0a1f37a-502d-40f4-820d-61148338e990 service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 681.846847] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-d0a1f37a-502d-40f4-820d-61148338e990 service nova] Enqueued Resource ID: 1fb628f5-9a12-4243-8b91-67632c4c9291 with Priority: HIGHEST for action port [ 681.847712] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 681.847870] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 681.847958] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fb628f5-9a12-4243-8b91-67632c4c9291 with Priority: HIGHEST for action port [ 681.848241] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.848361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.848450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.848628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.848718] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.849927] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.850123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.850377] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fb628f5-9a12-4243-8b91-67632c4c9291 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.850377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.850598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.850791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.850791] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb628f5-9a12-4243-8b91-67632c4c9291',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.886490] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 681.886490] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 deletion is rescheduled due to dependency. [ 681.886816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.887136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.887671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.888259] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.888259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.888259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.888259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.889187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.889187] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.316901] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.317498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-177" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.317498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-177" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.317637] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-177" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.317776] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.317932] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.318037] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.318255] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.318419] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.318589] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.318762] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.318859] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.318929] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.318986] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.319110] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.319279] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.327043] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.327242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.327315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.327563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.327660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.327859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.327952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.328029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.328717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.328717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.328717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c already deleted. [ 682.328717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.338677] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.338911] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.339021] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.339207] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-177" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.339607] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-f3c96660-f5dc-4253-a19d-a0c9418f93b6 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.339745] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.339810] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.340173] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.340371] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c96660-f5dc-4253-a19d-a0c9418f93b6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.352560] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.352801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.354251] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fb628f5-9a12-4243-8b91-67632c4c9291 with status ACTIVE [ 682.354561] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.354755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.354873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.355264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.355414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.355801] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.355910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.355961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.356205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.356336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.356620] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.356772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.356876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.357113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.357237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.357368] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fb628f5-9a12-4243-8b91-67632c4c9291 is going to be updated. [ 682.380331] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.380676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.380766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.381274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.381414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.381581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fb628f5-9a12-4243-8b91-67632c4c9291" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.392438] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.843533] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.843800] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.843800] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.844440] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.844440] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.844644] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port f3c96660-f5dc-4253-a19d-a0c9418f93b6 not found, creating... [ 682.844799] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.845031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.845137] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.845416] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.845569] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.845959] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.846166] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.846297] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.846535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.846700] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.846845] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: f3c96660-f5dc-4253-a19d-a0c9418f93b6 is going to be created. [ 682.873659] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.873931] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.874112] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.874323] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.874561] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.874788] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.895122] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.397597] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.398108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.398108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.398542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.398661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.398784] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 683.431523] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.431716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.431822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.432085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.432247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.441674] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 683.514689] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.514897] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-130" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.514984] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-130" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.519029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-130" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.519029] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.519029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.519029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.519029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.519029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.519029] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.519029] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.519029] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.519029] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.519029] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.519029] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.519029] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.538324] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.538495] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.538624] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.538799] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-130" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.539126] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-5c936338-6881-4c64-9760-ec90224f4fe0 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.539294] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.539417] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.539756] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.539961] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c936338-6881-4c64-9760-ec90224f4fe0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.606935] env[66123]: INFO networking_nsxv3.common.synchronization [req-b93adb62-b4b5-4769-884d-63a5f0d36ffd req-68341d99-89e7-4bc2-a3d1-550ec7059328 service nova] Enqueued Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_rules [ 683.607018] env[66123]: INFO networking_nsxv3.common.synchronization [req-b93adb62-b4b5-4769-884d-63a5f0d36ffd req-68341d99-89e7-4bc2-a3d1-550ec7059328 service nova] Enqueued Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_members [ 683.607144] env[66123]: INFO networking_nsxv3.common.synchronization [req-b93adb62-b4b5-4769-884d-63a5f0d36ffd req-68341d99-89e7-4bc2-a3d1-550ec7059328 service nova] Enqueued Resource ID: f3c96660-f5dc-4253-a19d-a0c9418f93b6 with Priority: HIGHEST for action port [ 683.607377] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_rules [ 683.607508] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_members [ 683.607605] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c96660-f5dc-4253-a19d-a0c9418f93b6 with Priority: HIGHEST for action port [ 683.608247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.608410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.608522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.608828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.608889] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.609727] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.611801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.611976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.612527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.614169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.614281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.614350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.614518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.614609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.614766] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.615621] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3c96660-f5dc-4253-a19d-a0c9418f93b6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.615727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.615793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.615948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.616032] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c96660-f5dc-4253-a19d-a0c9418f93b6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.043342] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.043559] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.043679] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.044021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.044175] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.044322] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 5c936338-6881-4c64-9760-ec90224f4fe0 not found, creating... [ 684.044569] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.044726] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.044824] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.045067] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.045198] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.045468] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.045612] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.045720] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.045914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.046055] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.046189] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 5c936338-6881-4c64-9760-ec90224f4fe0 is going to be created. [ 684.067762] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.067997] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.068139] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.068412] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.068635] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.068844] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.118186] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.118331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.118538] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.119436] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3c96660-f5dc-4253-a19d-a0c9418f93b6 with status ACTIVE [ 684.119618] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.119731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.119797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.119994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.120100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.120274] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.120372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.120437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.120587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.120688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.120866] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.121024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.122472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.123745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.123875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.123972] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3c96660-f5dc-4253-a19d-a0c9418f93b6 is going to be updated. [ 684.161087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.161087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.161087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.161087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.161087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.161470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3c96660-f5dc-4253-a19d-a0c9418f93b6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.628140] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.879983] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-80405e2c-c41b-46ce-b68e-cc9a901ecda2 service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 684.879983] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-80405e2c-c41b-46ce-b68e-cc9a901ecda2 service nova] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 684.879983] env[66123]: INFO networking_nsxv3.common.synchronization [req-76da71bc-d233-44e5-bac4-feaaa51902fe req-80405e2c-c41b-46ce-b68e-cc9a901ecda2 service nova] Enqueued Resource ID: 5c936338-6881-4c64-9760-ec90224f4fe0 with Priority: HIGHEST for action port [ 684.880546] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_rules [ 684.881073] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 684.881353] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c936338-6881-4c64-9760-ec90224f4fe0 with Priority: HIGHEST for action port [ 684.881756] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.883435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.883435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.883435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.883435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c936338-6881-4c64-9760-ec90224f4fe0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.883435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.883435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.883435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.883435] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c936338-6881-4c64-9760-ec90224f4fe0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.134165] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.134386] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.134436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.134654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.134753] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.134851] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c is going to be created. [ 685.168243] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.168475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.168475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.168642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.168783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.179377] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c in Status: UNINITIALIZED for 2s [ 685.385301] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c936338-6881-4c64-9760-ec90224f4fe0 with status ACTIVE [ 685.385587] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.385691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.385769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.385996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.386139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.386340] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.386448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.386511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.386667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.386741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.387264] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.387264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.387264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.387264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.387264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.387620] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c936338-6881-4c64-9760-ec90224f4fe0 is going to be updated. [ 685.409349] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.409513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.409560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.409772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.409915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.410092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c936338-6881-4c64-9760-ec90224f4fe0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.451628] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 685.451730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.451824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.452133] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.452282] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.452418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.452599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.453060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.453242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.453845] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.956639] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.458627] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.941563] env[66123]: INFO networking_nsxv3.common.synchronization [req-8b5f7319-0c0c-4d67-bc3d-dad24851d2e0 req-b79f7e97-fad7-484a-8691-415b73742899 tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 686.942116] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 686.942419] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.942537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.942602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.943280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.943420] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.943561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.943644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.944170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.944170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.944400] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.962313] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.962313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.962313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.962313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.962313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.962313] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 687.011488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.011488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.011488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.011720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.011845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.022952] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 687.190327] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c in Status: SUCCESS [ 687.190327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.190461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.190769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.190921] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.191232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.191232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.191318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.191556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.191556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.191682] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.382838] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.383096] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.383170] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.383423] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.383668] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.383850] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.383954] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.384250] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.384373] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.384621] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.384734] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.384849] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.384961] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.385132] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.385252] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.385403] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.405239] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.405404] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.405550] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.405710] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-558" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.406034] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-1432f209-f62a-4bd6-978d-3d8f80cda63e taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.406209] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.406326] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.406653] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.406786] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1432f209-f62a-4bd6-978d-3d8f80cda63e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.449567] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.695432] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.695724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.695800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.696108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.696373] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.696530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.696641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.696879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.697013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.697113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.697275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.697380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.697448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.697585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.698486] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.698486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.698486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.698486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.698486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.698486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.698486] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.909448] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.909664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.909809] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.910090] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.910239] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.910389] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 1432f209-f62a-4bd6-978d-3d8f80cda63e not found, creating... [ 687.910678] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.910941] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.911088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.911314] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.911445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.911745] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.912245] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.912245] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.912410] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.912410] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.912569] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 1432f209-f62a-4bd6-978d-3d8f80cda63e is going to be created. [ 687.936482] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.936767] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.936933] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.937284] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.937561] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.937832] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.951522] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.201645] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc1efda8-467e-44a4-8d86-5f1d56a91f3c: rpc.has_security_group_logging(os_id): False [ 688.223120] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.223307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.223351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.223560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.223655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.223913] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.224037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.224079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.224237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.224311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.224504] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.224597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.224655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.224792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.224894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.225224] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.225347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.225408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.225599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.225681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.226306] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c is going to be created. [ 688.290939] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.291331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.291413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.291635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.291821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.309843] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c in Status: IN_PROGRESS for 2s [ 688.399397] env[66123]: INFO networking_nsxv3.common.synchronization [None req-69331fb3-d221-40de-9c3f-b77385d1e116 None None] Enqueued Resource ID: d5460f55-d148-4aed-9e05-fe4781d2469f with Priority: HIGHEST for action port [ 688.400058] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5460f55-d148-4aed-9e05-fe4781d2469f with Priority: HIGHEST for action port [ 688.400375] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5460f55-d148-4aed-9e05-fe4781d2469f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.400500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5460f55-d148-4aed-9e05-fe4781d2469f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.400563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5460f55-d148-4aed-9e05-fe4781d2469f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.400983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5460f55-d148-4aed-9e05-fe4781d2469f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.401079] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5460f55-d148-4aed-9e05-fe4781d2469f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.454842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.455124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.455227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.455457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.455552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.455653] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 688.487807] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.487992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.487992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.488667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.488872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.498676] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 688.625123] env[66123]: INFO networking_nsxv3.common.synchronization [req-8b5f7319-0c0c-4d67-bc3d-dad24851d2e0 req-74b3af0f-d776-462b-b1bb-46f8c728504a service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 688.625298] env[66123]: INFO networking_nsxv3.common.synchronization [req-8b5f7319-0c0c-4d67-bc3d-dad24851d2e0 req-74b3af0f-d776-462b-b1bb-46f8c728504a service nova] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 688.625465] env[66123]: INFO networking_nsxv3.common.synchronization [req-8b5f7319-0c0c-4d67-bc3d-dad24851d2e0 req-74b3af0f-d776-462b-b1bb-46f8c728504a service nova] Enqueued Resource ID: 1432f209-f62a-4bd6-978d-3d8f80cda63e with Priority: HIGHEST for action port [ 688.625694] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_rules [ 688.625829] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 688.626221] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1432f209-f62a-4bd6-978d-3d8f80cda63e with Priority: HIGHEST for action port [ 688.626487] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.626613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.626681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.626879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.626956] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.628475] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.628685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.628758] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1432f209-f62a-4bd6-978d-3d8f80cda63e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.628853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.628945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.629078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.629152] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1432f209-f62a-4bd6-978d-3d8f80cda63e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.749282] env[66123]: INFO networking_nsxv3.common.synchronization [None req-46e00c90-561d-46cb-bf19-eded12818141 tempest-MigrationsAdminTest-723267321 tempest-MigrationsAdminTest-723267321-project-member] Enqueued Resource ID: 33414c61-0ed7-4c4c-a50c-06964eea749b with Priority: HIGHEST for action security_group_rules [ 688.749828] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33414c61-0ed7-4c4c-a50c-06964eea749b with Priority: HIGHEST for action security_group_rules [ 688.750143] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33414c61-0ed7-4c4c-a50c-06964eea749b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.750262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.750323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.750563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.750721] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33414c61-0ed7-4c4c-a50c-06964eea749b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.903266] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5460f55-d148-4aed-9e05-fe4781d2469f [ 688.903501] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.903646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.903700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.904020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.904117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.904218] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5460f55-d148-4aed-9e05-fe4781d2469f already deleted. [ 688.904329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5460f55-d148-4aed-9e05-fe4781d2469f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.036765] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.036765] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.036765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.036765] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.038801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.038801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.038801] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.038801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.039085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.039700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.039700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.039895] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.130663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.130663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.134657] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1432f209-f62a-4bd6-978d-3d8f80cda63e with status ACTIVE [ 689.134657] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.134657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.134657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.135013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.135013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.135107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.135176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.135243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.135553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.135553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.135692] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.135807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.135850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.135987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.136150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.136150] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1432f209-f62a-4bd6-978d-3d8f80cda63e is going to be updated. [ 689.161573] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.161573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.161573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.161573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.161911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.161911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1432f209-f62a-4bd6-978d-3d8f80cda63e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.274262] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.274581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.274581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.274842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.274918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.275042] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33414c61-0ed7-4c4c-a50c-06964eea749b already deleted. [ 689.275128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.343351] env[66123]: INFO networking_nsxv3.common.synchronization [None req-4b3e1575-5455-4acb-afe6-cf9c802871a2 tempest-MigrationsAdminTest-723267321 tempest-MigrationsAdminTest-723267321-project-member] Enqueued Resource ID: 33414c61-0ed7-4c4c-a50c-06964eea749b with Priority: HIGHEST for action security_group_rules [ 689.343915] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33414c61-0ed7-4c4c-a50c-06964eea749b with Priority: HIGHEST for action security_group_rules [ 689.348998] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33414c61-0ed7-4c4c-a50c-06964eea749b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.349355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.349355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.350079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.350079] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33414c61-0ed7-4c4c-a50c-06964eea749b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.542393] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.542573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.543162] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.872559] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.872698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.872817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.873037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.873155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.873272] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33414c61-0ed7-4c4c-a50c-06964eea749b already deleted. [ 689.873401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33414c61-0ed7-4c4c-a50c-06964eea749b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.046990] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.326483] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c in Status: SUCCESS [ 690.326483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.512304] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 690.512535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.512710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.513295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.513940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.514195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.514195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.515138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.515969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.515969] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.550422] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.550422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.550422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.550704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.550704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.550986] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 690.581515] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.582087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.582146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.582354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.582485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.593150] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 691.018405] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.210394] env[66123]: INFO networking_nsxv3.common.synchronization [None req-507d6d89-df51-41cf-ab19-e289993b0a76 None None] Enqueued Resource ID: a4a864df-506a-4f01-9070-a64827b786f3 with Priority: HIGHEST for action port [ 691.210896] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a864df-506a-4f01-9070-a64827b786f3 with Priority: HIGHEST for action port [ 691.214150] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4a864df-506a-4f01-9070-a64827b786f3 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.214357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4a864df-506a-4f01-9070-a64827b786f3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.215578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4a864df-506a-4f01-9070-a64827b786f3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.215578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4a864df-506a-4f01-9070-a64827b786f3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.215578] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a864df-506a-4f01-9070-a64827b786f3',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.521507] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.717978] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4a864df-506a-4f01-9070-a64827b786f3 [ 691.718301] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.721346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.721346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.721346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.721346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.721346] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4a864df-506a-4f01-9070-a64827b786f3 already deleted. [ 691.721346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4a864df-506a-4f01-9070-a64827b786f3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.024805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.025050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.025130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.025371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.026053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.026053] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 692.064087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.064087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.064087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.064087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.064087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.076843] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 692.611338] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 692.611620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.611732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.611948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.612155] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.612273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.612328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.612487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.612625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.612653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.612861] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.613116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.613200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.613427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.613602] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.613702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.613764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.617222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.617472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.617669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.617818] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.123528] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2: rpc.has_security_group_logging(os_id): False [ 693.143451] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.143451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.143451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.143451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.143451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.143834] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.143834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.143948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.144174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.144251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.144520] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.144654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.144746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.144945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.145525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.145525] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.145525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.145688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.145806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.145968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.146057] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 693.226488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.226678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.226742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.227288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.227288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.243206] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 694.088883] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 694.089185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.090990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.090990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.090990] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.091172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.091172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.091725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.091725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.091725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.091725] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.292435] env[66123]: INFO networking_nsxv3.common.synchronization [req-0bddf461-983f-43d2-a5d9-2017b6537c9b req-fed19dee-1f9d-48b2-b072-815b2db421d7 tempest-FloatingIPsAssociationTestJSON-1710505517 tempest-FloatingIPsAssociationTestJSON-1710505517-project-member] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 694.293101] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 694.293816] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.293816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.293816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.294070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.294880] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.294880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.294880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.294880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.294880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.295062] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.594528] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.594715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.594845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.594984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.595208] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.595311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.595376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.595554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.595643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.595739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.595902] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.596156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.596156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.598666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.598666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.598666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.598666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.598666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.598666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598666] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.677282] env[66123]: INFO networking_nsxv3.common.synchronization [req-e0d18888-cf6e-4113-ac56-f5f68d80639a req-5b8b6faf-8f29-4730-9fee-7369ea3a1dc0 tempest-ServerGroupTestJSON-1329710432 tempest-ServerGroupTestJSON-1329710432-project-member] Enqueued Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_members [ 694.678366] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGHEST for action security_group_members [ 694.679048] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.679048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.679048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.679357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.679544] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.679747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.679867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.680599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.680599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.680599] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.797229] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.104206] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3b19fe3-562d-4163-b8e0-7d5f0c6475ed: rpc.has_security_group_logging(os_id): False [ 695.123318] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.123495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.123552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.123765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.123861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.124148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.124238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.124307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.124471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.124550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.124735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.124838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.124923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.125166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.125166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.125376] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.125492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.125522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.125660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.125735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.125819] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 695.134019] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e24628f2-deae-4d22-b1cb-a77fb400838a None None] Enqueued Resource ID: 5ce4bc45-6818-4358-949b-0c5e95f87372 with Priority: HIGHEST for action port [ 695.134706] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce4bc45-6818-4358-949b-0c5e95f87372 with Priority: HIGHEST for action port [ 695.134863] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ce4bc45-6818-4358-949b-0c5e95f87372 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.134985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ce4bc45-6818-4358-949b-0c5e95f87372" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.135093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ce4bc45-6818-4358-949b-0c5e95f87372" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.135332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ce4bc45-6818-4358-949b-0c5e95f87372" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.135410] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ce4bc45-6818-4358-949b-0c5e95f87372',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.186814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.187017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.187055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.187354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.187468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.187673] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.187772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.187837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.187991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.188136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.188238] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 is going to be updated. [ 695.190634] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.190910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.190910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.191093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.191204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.222448] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 695.234581] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.234581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.234581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.234581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.234581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.266716] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 in Status: IN_PROGRESS for 2s [ 695.286582] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 695.286829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.287087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.287321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.287400] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.300290] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.638101] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ce4bc45-6818-4358-949b-0c5e95f87372 [ 695.638341] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.638476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.638696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.638774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.638859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.638957] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ce4bc45-6818-4358-949b-0c5e95f87372 already deleted. [ 695.639045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ce4bc45-6818-4358-949b-0c5e95f87372" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.791351] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.791351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.791351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.791668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.791715] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.791788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.791973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.792098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.792098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.792266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.792266] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.805013] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.805013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.805013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.805013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.805013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.805013] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be updated. [ 695.836891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.837116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.837211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.837961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.839015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.849087] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: IN_PROGRESS for 2s [ 696.296368] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.299296] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.299296] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.299296] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.299296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.302828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.302828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.302828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.302828] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.805874] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2: rpc.has_security_group_logging(os_id): False [ 696.828460] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.828921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.832877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.832877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.832877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.832877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.832877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.832877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.832877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.832877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.834209] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.834209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.834209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.834359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.834359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.834568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.834648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.834710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.834839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.835334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.835334] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 696.920495] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.920646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.920680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.920969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.921088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.958677] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 697.248628] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 697.250067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.283744] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 in Status: SUCCESS [ 697.283950] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 deletion is rescheduled due to dependency. [ 697.284098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.870286] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: SUCCESS [ 697.872841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.088507] env[66123]: INFO networking_nsxv3.common.synchronization [req-ce797943-e488-4ae0-9a69-a471dc94eb19 req-6cadaed5-88c2-4f95-b906-7ab9db136dfd tempest-ServerMetadataNegativeTestJSON-543750819 tempest-ServerMetadataNegativeTestJSON-543750819-project-member] Enqueued Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_members [ 698.089155] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_members [ 698.089443] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.089570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.089636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.089902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.090155] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.090293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.090369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.090678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.090678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.090790] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.563231] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-488 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.563437] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-488" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.563507] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-488" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.564322] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-488" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.565651] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.565651] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.565651] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.566073] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.566073] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.566188] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.566220] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.566317] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.566504] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.566504] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.566601] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.566755] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.593023] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.593023] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.593023] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.593023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-488" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.593249] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-abec524a-45f7-4b13-809f-d4a08b9b420e taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.593382] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.593499] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.593810] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.593967] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abec524a-45f7-4b13-809f-d4a08b9b420e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.595271] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.595421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.597043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.597043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.597043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.597043] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.597043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.599361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.599559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.599649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.599747] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 already deleted. [ 698.600022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.601839] env[66123]: INFO networking_nsxv3.common.synchronization [None req-67335f79-1c1a-4e11-b2bf-461d5527ad44 None None] Enqueued Resource ID: 749f7e2b-c07a-437c-b520-4a133d8df2f9 with Priority: HIGHEST for action port [ 698.602778] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 749f7e2b-c07a-437c-b520-4a133d8df2f9 with Priority: HIGHEST for action port [ 698.603881] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-749f7e2b-c07a-437c-b520-4a133d8df2f9 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.604063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-749f7e2b-c07a-437c-b520-4a133d8df2f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.604137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-749f7e2b-c07a-437c-b520-4a133d8df2f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.604373] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-749f7e2b-c07a-437c-b520-4a133d8df2f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.604480] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('749f7e2b-c07a-437c-b520-4a133d8df2f9',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.988965] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 698.989456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.058962] env[66123]: INFO networking_nsxv3.common.synchronization [None req-b30071c3-03eb-4c78-a4e6-971844926272 tempest-ServersTestManualDisk-969714279 tempest-ServersTestManualDisk-969714279-project-member] Enqueued Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_rules [ 699.059442] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_rules [ 699.059954] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.059954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.059954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.060306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.060390] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.101872] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.102128] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.102249] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.103042] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.103042] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.103042] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port abec524a-45f7-4b13-809f-d4a08b9b420e not found, creating... [ 699.103198] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.103845] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.103996] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.104410] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.104565] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.105160] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.105473] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.105473] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.105625] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.106664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.106664] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: abec524a-45f7-4b13-809f-d4a08b9b420e is going to be created. [ 699.107731] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 749f7e2b-c07a-437c-b520-4a133d8df2f9 [ 699.107939] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.108059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.108123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.108369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.108967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.108967] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:749f7e2b-c07a-437c-b520-4a133d8df2f9 already deleted. [ 699.108967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-749f7e2b-c07a-437c-b520-4a133d8df2f9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.133841] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.133841] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.133841] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.133994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.134194] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.135048] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.202084] env[66123]: INFO networking_nsxv3.common.synchronization [None req-af7a6eae-8401-49a8-bb97-7027feddb0d8 tempest-ServersTestManualDisk-969714279 tempest-ServersTestManualDisk-969714279-project-member] Enqueued Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_rules [ 699.203994] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_rules [ 699.203994] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.203994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.584386] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.584532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.584601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.584809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.584898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.584992] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 already deleted. [ 699.585129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.585340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.585501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.585582] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.610402] env[66123]: INFO networking_nsxv3.common.synchronization [None req-9dedb113-c093-465a-8b7a-1a6d5fb85a68 None None] Enqueued Resource ID: c1072529-0d8b-41e3-a22c-0b4ab1308982 with Priority: HIGHEST for action port [ 699.610549] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1072529-0d8b-41e3-a22c-0b4ab1308982 with Priority: HIGHEST for action port [ 699.610786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1072529-0d8b-41e3-a22c-0b4ab1308982 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.610961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1072529-0d8b-41e3-a22c-0b4ab1308982" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.611144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1072529-0d8b-41e3-a22c-0b4ab1308982" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.611253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1072529-0d8b-41e3-a22c-0b4ab1308982" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.611328] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1072529-0d8b-41e3-a22c-0b4ab1308982',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.031510] env[66123]: INFO networking_nsxv3.common.synchronization [req-ce797943-e488-4ae0-9a69-a471dc94eb19 req-564cea46-7215-454b-b2f4-aee8743cfb0b service nova] Enqueued Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_rules [ 700.031510] env[66123]: INFO networking_nsxv3.common.synchronization [req-ce797943-e488-4ae0-9a69-a471dc94eb19 req-564cea46-7215-454b-b2f4-aee8743cfb0b service nova] Enqueued Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_members [ 700.031510] env[66123]: INFO networking_nsxv3.common.synchronization [req-ce797943-e488-4ae0-9a69-a471dc94eb19 req-564cea46-7215-454b-b2f4-aee8743cfb0b service nova] Enqueued Resource ID: abec524a-45f7-4b13-809f-d4a08b9b420e with Priority: HIGHEST for action port [ 700.031924] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_rules [ 700.032497] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_members [ 700.032605] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abec524a-45f7-4b13-809f-d4a08b9b420e with Priority: HIGHEST for action port [ 700.033227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.033227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.033227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.033428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.033454] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.034966] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.034966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.034966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.034966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.034966] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.035255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.035255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.035308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.035390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.035495] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.037539] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-abec524a-45f7-4b13-809f-d4a08b9b420e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.037711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.037841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.038065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.038310] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abec524a-45f7-4b13-809f-d4a08b9b420e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.109454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.109789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.109863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.110156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.110309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.110414] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 already deleted. [ 700.110502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.112972] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1072529-0d8b-41e3-a22c-0b4ab1308982 [ 700.113233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.113389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.113462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.113711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.113799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.113893] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1072529-0d8b-41e3-a22c-0b4ab1308982 already deleted. [ 700.113977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1072529-0d8b-41e3-a22c-0b4ab1308982" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.543030] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.543030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.543030] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abec524a-45f7-4b13-809f-d4a08b9b420e with status ACTIVE [ 700.543030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.543030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.543030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.546048] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.547030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.547701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.548106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.548319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.550171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abec524a-45f7-4b13-809f-d4a08b9b420e is going to be updated. [ 700.570691] env[66123]: INFO networking_nsxv3.common.synchronization [req-91dfad8c-441c-43d1-845f-c54ca792b020 req-cec0ad0d-c897-44bb-98e6-2db76c8f1882 tempest-ServersAdminNegativeTestJSON-1257558661 tempest-ServersAdminNegativeTestJSON-1257558661-project-member] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 700.571592] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.571722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.571791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.571990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.572600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.572882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abec524a-45f7-4b13-809f-d4a08b9b420e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.573480] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 700.574202] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.574765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.574899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.575200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.575390] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.575544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.575647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.575849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.575993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.576115] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.638934] env[66123]: INFO networking_nsxv3.common.synchronization [None req-fc8ebe46-b14c-446b-a490-1e5390a6695a None None] Enqueued Resource ID: 9c428459-734f-4b47-998b-94abbbbda1e8 with Priority: HIGHEST for action port [ 700.641030] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c428459-734f-4b47-998b-94abbbbda1e8 with Priority: HIGHEST for action port [ 700.641533] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c428459-734f-4b47-998b-94abbbbda1e8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.641694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c428459-734f-4b47-998b-94abbbbda1e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.641802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c428459-734f-4b47-998b-94abbbbda1e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.642017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c428459-734f-4b47-998b-94abbbbda1e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.642112] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c428459-734f-4b47-998b-94abbbbda1e8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.978575] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.979103] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.979251] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.979505] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.979760] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.979940] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.980158] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.980376] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.980514] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.980714] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.980820] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.980952] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.981170] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.981306] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.981435] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.981581] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.004580] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.004783] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.004919] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.005383] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.005567] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.005994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.005994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.006428] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.006496] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.048154] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.078397] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.147035] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c428459-734f-4b47-998b-94abbbbda1e8 [ 701.149413] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.149413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.149413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.149413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.149413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.149413] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c428459-734f-4b47-998b-94abbbbda1e8 already deleted. [ 701.149413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c428459-734f-4b47-998b-94abbbbda1e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.510199] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.510513] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.511142] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.511142] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.511271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.511867] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe not found, creating... [ 701.511867] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.512048] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.512879] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.513239] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.513414] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.513736] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.514820] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.514820] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.514820] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.514820] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.514820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe is going to be created. [ 701.538652] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.538652] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.538652] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.538652] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.538652] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.538921] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.550675] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.550871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.550933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.552035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.552035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.552035] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 is going to be created. [ 701.578568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.578758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.578810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.579151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.579151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.581055] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.595498] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 in Status: UNINITIALIZED for 2s [ 702.085999] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.087319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.087319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.087319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.087319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.087319] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd is going to be updated. [ 702.123288] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.123440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.123569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.123871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.124049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.137782] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: IN_PROGRESS for 2s [ 702.335306] env[66123]: INFO networking_nsxv3.common.synchronization [req-91dfad8c-441c-43d1-845f-c54ca792b020 req-e3237291-fcc1-454c-9ae3-ec217ebcf8ea service nova] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_rules [ 702.337608] env[66123]: INFO networking_nsxv3.common.synchronization [req-91dfad8c-441c-43d1-845f-c54ca792b020 req-e3237291-fcc1-454c-9ae3-ec217ebcf8ea service nova] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 702.337608] env[66123]: INFO networking_nsxv3.common.synchronization [req-91dfad8c-441c-43d1-845f-c54ca792b020 req-e3237291-fcc1-454c-9ae3-ec217ebcf8ea service nova] Enqueued Resource ID: 8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe with Priority: HIGHEST for action port [ 702.337608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_rules [ 702.337818] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 702.338507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe with Priority: HIGHEST for action port [ 702.338507] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.338507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.338693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.339266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.339266] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.341184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.341184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.341184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.341184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.341184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.341184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.341184] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.844149] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.844149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.844287] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe with status ACTIVE [ 702.844714] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.844714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.844714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.844861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.844981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.845189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.845278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.845436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.845527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.845606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.846074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.846157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.846223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.846387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.847164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.847260] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe is going to be updated. [ 702.872137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.872137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.872137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.872137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.872137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.872137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dc00a1b-dcd2-4a7a-9138-2f40e9a52afe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.236936] env[66123]: INFO networking_nsxv3.common.synchronization [None req-03428205-ced5-4248-a1c6-a9ea392f0fad None None] Enqueued Resource ID: 0057a7a6-367d-430f-b5e1-03a6455b68a1 with Priority: HIGHEST for action port [ 703.237297] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0057a7a6-367d-430f-b5e1-03a6455b68a1 with Priority: HIGHEST for action port [ 703.237771] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-0057a7a6-367d-430f-b5e1-03a6455b68a1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.237908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0057a7a6-367d-430f-b5e1-03a6455b68a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.238408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0057a7a6-367d-430f-b5e1-03a6455b68a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.238791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0057a7a6-367d-430f-b5e1-03a6455b68a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.238951] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0057a7a6-367d-430f-b5e1-03a6455b68a1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.610271] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 in Status: SUCCESS [ 703.610271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.610271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.610408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.611983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.616275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.616275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.616275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.616275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.616275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.616275] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.745840] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0057a7a6-367d-430f-b5e1-03a6455b68a1 [ 703.745840] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.745840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.745840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.745840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.745840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.745840] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0057a7a6-367d-430f-b5e1-03a6455b68a1 already deleted. [ 703.745840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0057a7a6-367d-430f-b5e1-03a6455b68a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.124643] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.124804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.124879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.125084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.125412] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.125412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.125412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.127044] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.127044] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.127044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.127044] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.147554] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: SUCCESS [ 704.147802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.148030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.148683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.148683] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.148683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.148683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.148949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.148949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.148949] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.628782] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8bef11c-ef0e-4ed1-b9a3-f27537962a61: rpc.has_security_group_logging(os_id): False [ 704.648177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.648337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.648411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.648660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.648749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.648957] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.649058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.649113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.649262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.649349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.649540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.649627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.649687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.649840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.649917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.650450] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.650450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.650450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.650450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.650666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.650666] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 is going to be created. [ 704.653706] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.718596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.718912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.719084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.719347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.719552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.732296] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 in Status: IN_PROGRESS for 2s [ 705.158289] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.665525] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.665525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.665525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.665525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.666035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.666035] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd is going to be updated. [ 705.703335] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.703512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.704163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.704421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.704600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.715984] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: IN_PROGRESS for 2s [ 706.368967] env[66123]: INFO networking_nsxv3.common.synchronization [None req-0f890b45-68c6-41a4-9bab-64c8222c019f None None] Enqueued Resource ID: 041b9621-eebf-4399-8b83-1b289e7d39c9 with Priority: HIGHEST for action port [ 706.369248] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041b9621-eebf-4399-8b83-1b289e7d39c9 with Priority: HIGHEST for action port [ 706.369840] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-041b9621-eebf-4399-8b83-1b289e7d39c9 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.369967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-041b9621-eebf-4399-8b83-1b289e7d39c9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.370050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-041b9621-eebf-4399-8b83-1b289e7d39c9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.370315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-041b9621-eebf-4399-8b83-1b289e7d39c9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.370412] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('041b9621-eebf-4399-8b83-1b289e7d39c9',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.746774] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 in Status: SUCCESS [ 706.746774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.872343] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 041b9621-eebf-4399-8b83-1b289e7d39c9 [ 706.872604] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.872745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.872819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.873250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.873353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.873802] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:041b9621-eebf-4399-8b83-1b289e7d39c9 already deleted. [ 706.873802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-041b9621-eebf-4399-8b83-1b289e7d39c9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.005046] env[66123]: INFO networking_nsxv3.common.synchronization [req-70f89611-35c1-45f7-84b6-255f9e1fcc4f req-ca059263-b9c5-49a8-b674-09fc42083580 tempest-VolumesAssistedSnapshotsTest-1481914958 tempest-VolumesAssistedSnapshotsTest-1481914958-project-member] Enqueued Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_members [ 707.005966] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGHEST for action security_group_members [ 707.006051] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.006855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.006855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.006855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.007010] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.007010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.007541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.007541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.007541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.007855] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.510311] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.510521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.510574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.510790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.510885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.511102] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.511204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.512160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.512160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.512160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.512160] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 is going to be updated. [ 707.555287] env[66123]: INFO networking_nsxv3.common.synchronization [req-d431634c-b574-4f1d-8908-4bf2b32200a9 req-353771ed-bd12-4d45-a777-6b56a1a12c53 tempest-ServersNegativeTestJSON-927005488 tempest-ServersNegativeTestJSON-927005488-project-member] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 707.555959] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 707.557792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.557792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.557792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.557792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.558153] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.558290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.558495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.558559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.558645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.558823] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.571905] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.571905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.571905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.571905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.571905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.583079] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 in Status: IN_PROGRESS for 2s [ 707.625472] env[66123]: INFO networking_nsxv3.common.synchronization [None req-a7f9a604-5f87-4a72-b557-d1ce4b4ed5dc None None] Enqueued Resource ID: cfa9ff67-ad1b-439c-a799-7b238b04031d with Priority: HIGHEST for action port [ 707.627142] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfa9ff67-ad1b-439c-a799-7b238b04031d with Priority: HIGHEST for action port [ 707.627142] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfa9ff67-ad1b-439c-a799-7b238b04031d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.627142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfa9ff67-ad1b-439c-a799-7b238b04031d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.627142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfa9ff67-ad1b-439c-a799-7b238b04031d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.628503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfa9ff67-ad1b-439c-a799-7b238b04031d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.628503] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfa9ff67-ad1b-439c-a799-7b238b04031d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.733081] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: SUCCESS [ 707.733235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.733272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.733514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.733717] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.733840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.733910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.734079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.734164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.734250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.734340] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.062892] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.062892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.063331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.063331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.063331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.063543] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.063670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.063711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.063850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.063965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.064093] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c already deleted. [ 708.064181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.130171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfa9ff67-ad1b-439c-a799-7b238b04031d [ 708.130410] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.130544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.130614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.130844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.130946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.131055] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfa9ff67-ad1b-439c-a799-7b238b04031d already deleted. [ 708.131141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfa9ff67-ad1b-439c-a799-7b238b04031d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.237893] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.238137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.238241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.238601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.238898] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.239024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.239244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.239351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.239475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.239599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.239814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.239949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.241148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.241148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.241148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.241148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.241148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.241148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.241148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.241148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.241854] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.372439] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.372645] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.372790] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.373102] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.373370] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.373520] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.373629] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.373838] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.373982] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.374287] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.374397] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.374498] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.374597] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.374705] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.374796] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.374922] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.393280] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.393452] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.393586] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.393776] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.394186] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.394433] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.394531] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.394841] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.394990] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.745188] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc8e203a-a322-44a7-8e22-6a43e3c9abbd: rpc.has_security_group_logging(os_id): False [ 708.771242] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.771242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.771242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.771738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.771738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.771738] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.771738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.771738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.772184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.772184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.772277] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.772429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.772429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.772694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.772694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.772912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.772912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.773183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.773183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.773437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.773553] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd is going to be updated. [ 708.844211] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.844496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.844496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.844652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.844844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.866026] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: IN_PROGRESS for 2s [ 708.898386] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.898667] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.898751] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.899153] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.899216] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.899389] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 not found, creating... [ 708.899698] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.900110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.900257] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.900542] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.900683] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.901053] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.901228] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.901582] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.901582] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.901717] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.901953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 is going to be created. [ 708.933565] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.933775] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.933937] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.934296] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.934596] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.934702] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.594291] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 in Status: SUCCESS [ 709.594560] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 deletion is rescheduled due to dependency. [ 709.594605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.644218] env[66123]: INFO networking_nsxv3.common.synchronization [req-d431634c-b574-4f1d-8908-4bf2b32200a9 req-fa2ead4c-c4fd-4bb2-8695-db454ef0e909 service nova] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_rules [ 709.644218] env[66123]: INFO networking_nsxv3.common.synchronization [req-d431634c-b574-4f1d-8908-4bf2b32200a9 req-fa2ead4c-c4fd-4bb2-8695-db454ef0e909 service nova] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 709.644218] env[66123]: INFO networking_nsxv3.common.synchronization [req-d431634c-b574-4f1d-8908-4bf2b32200a9 req-fa2ead4c-c4fd-4bb2-8695-db454ef0e909 service nova] Enqueued Resource ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 with Priority: HIGHEST for action port [ 709.644218] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_rules [ 709.644218] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 709.644218] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 with Priority: HIGHEST for action port [ 709.644218] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.644218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.644218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.644675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.644833] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.645842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.646082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.646238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.646474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.646735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.646942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.647096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.647397] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.647554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.647715] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.648879] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.649139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.649338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.649564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.649710] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.681567] env[66123]: INFO networking_nsxv3.common.synchronization [None req-0c3cd3cb-2aa3-4cd3-9ce2-14ea5302cebd None None] Enqueued Resource ID: 762132f9-13bf-40f2-8535-9d97a4049ec7 with Priority: HIGHEST for action port [ 709.682083] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762132f9-13bf-40f2-8535-9d97a4049ec7 with Priority: HIGHEST for action port [ 709.682429] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-762132f9-13bf-40f2-8535-9d97a4049ec7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.682536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-762132f9-13bf-40f2-8535-9d97a4049ec7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.682598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-762132f9-13bf-40f2-8535-9d97a4049ec7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.682832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-762132f9-13bf-40f2-8535-9d97a4049ec7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.682967] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('762132f9-13bf-40f2-8535-9d97a4049ec7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.102441] env[66123]: INFO networking_nsxv3.common.synchronization [req-f367bdd7-05e4-48da-b361-24d8bcebd910 req-044fbc7b-0360-4307-b50f-5415372a5b47 tempest-InstanceActionsTestJSON-30952341 tempest-InstanceActionsTestJSON-30952341-project-member] Enqueued Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_members [ 710.102781] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_members [ 710.103176] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a1c9505-3726-4617-ab67-cc7b3b1e107b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.103299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.103362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.103610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.106524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.106524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.106524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.106524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.106524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.106524] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.153338] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.153338] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.153757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.154608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 with status ACTIVE [ 710.154837] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.154991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.155287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.155492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.155612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.155876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.156032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.156132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.156965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.156965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.156965] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.156965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.156965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.156965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.156965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.156965] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 is going to be updated. [ 710.182023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.182023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.182023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.182023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.182023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.182023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.185459] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 762132f9-13bf-40f2-8535-9d97a4049ec7 [ 710.185779] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.185779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.185903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.186683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.186683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.186683] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:762132f9-13bf-40f2-8535-9d97a4049ec7 already deleted. [ 710.186683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-762132f9-13bf-40f2-8535-9d97a4049ec7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.472992] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-96 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.473218] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-96" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.473338] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-96" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.473650] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-96" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.473971] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.474189] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.474345] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.474592] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.474766] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.474998] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.475162] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.475291] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.475427] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.475556] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.475678] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.475827] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.532018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.532265] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.532439] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.532651] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-96" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.533053] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-cad393a7-ca47-42a8-9563-3edac30dc9ae taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.533310] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.533465] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.533805] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.534370] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cad393a7-ca47-42a8-9563-3edac30dc9ae',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.607975] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.608306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.608384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.608665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.608816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.609137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.609311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.609617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.609680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.609772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.609874] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b already deleted. [ 710.609962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.659135] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.824827] env[66123]: INFO networking_nsxv3.common.synchronization [req-2578226b-6d75-465f-984d-2ccbd092064c req-1bc83845-b72b-48ee-9ceb-a09aceff41e8 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 710.825880] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 710.825880] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.825880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.825880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.826172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.827185] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.827185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.827185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.827185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.827185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.827185] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.878244] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: SUCCESS [ 710.878244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.038360] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.038360] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.038360] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.038360] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.038360] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.038360] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port cad393a7-ca47-42a8-9563-3edac30dc9ae not found, creating... [ 711.038730] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.038730] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.038808] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.039637] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.039637] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.039637] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.039637] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.039824] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.039964] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.041368] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.041661] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: cad393a7-ca47-42a8-9563-3edac30dc9ae is going to be created. [ 711.069275] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.069275] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.069275] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.069275] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.069588] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.069677] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.162453] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.162612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.162683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.162898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.163065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.163171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be created. [ 711.196982] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.197286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.197359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.197613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.197811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.206745] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.207088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.207088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.207498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.207863] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.208038] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.208157] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.208384] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.208540] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.209456] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.209599] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.209770] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.209902] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.210030] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.210138] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.210269] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.225231] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: UNINITIALIZED for 2s [ 711.231251] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.231480] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.231606] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.231790] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.232164] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.232333] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.232446] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.232770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.232913] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1fbce9-2e85-47ef-a1fa-8e5d92c73183',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.330771] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.331040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.331101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.331328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.331424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.331637] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.331737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.331842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.331945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.332154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.332261] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 already deleted. [ 711.332396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.736280] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.736280] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.736866] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.736866] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.737036] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.737214] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 not found, creating... [ 711.737537] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.737739] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.737854] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.738110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.738252] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.738542] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.738719] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.738846] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.739440] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.739597] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.739739] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 is going to be created. [ 711.766926] env[66123]: INFO networking_nsxv3.common.synchronization [req-f367bdd7-05e4-48da-b361-24d8bcebd910 req-d65fcf46-829e-4bdc-9001-36d6ab42b8ed service nova] Enqueued Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_rules [ 711.767124] env[66123]: INFO networking_nsxv3.common.synchronization [req-f367bdd7-05e4-48da-b361-24d8bcebd910 req-d65fcf46-829e-4bdc-9001-36d6ab42b8ed service nova] Enqueued Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_members [ 711.767290] env[66123]: INFO networking_nsxv3.common.synchronization [req-f367bdd7-05e4-48da-b361-24d8bcebd910 req-d65fcf46-829e-4bdc-9001-36d6ab42b8ed service nova] Enqueued Resource ID: cad393a7-ca47-42a8-9563-3edac30dc9ae with Priority: HIGHEST for action port [ 711.767866] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_rules [ 711.768011] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_members [ 711.768105] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad393a7-ca47-42a8-9563-3edac30dc9ae with Priority: HIGHEST for action port [ 711.769255] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.769495] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.769570] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.769837] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.770077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.770304] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.771544] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a1c9505-3726-4617-ab67-cc7b3b1e107b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.771677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.771749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.771998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.772269] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.773258] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a1c9505-3726-4617-ab67-cc7b3b1e107b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.774299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.774299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.774299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.774299] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.774299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.774299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.774299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.774299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.774299] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.775919] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-cad393a7-ca47-42a8-9563-3edac30dc9ae taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.776065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.776138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.776302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.776378] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cad393a7-ca47-42a8-9563-3edac30dc9ae',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.281507] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a1c9505-3726-4617-ab67-cc7b3b1e107b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.281507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.283129] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.300137] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cad393a7-ca47-42a8-9563-3edac30dc9ae with status ACTIVE [ 712.300137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.300137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.300137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.300137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.300137] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cad393a7-ca47-42a8-9563-3edac30dc9ae is going to be updated. [ 712.337064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.337064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.337064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.337885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.337885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.337885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cad393a7-ca47-42a8-9563-3edac30dc9ae" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.348542] env[66123]: INFO networking_nsxv3.common.synchronization [None req-c101e99f-61ec-40dc-acf4-31f21c2c2a60 None None] Enqueued Resource ID: feef5a96-b442-4e3a-804c-83ebbcb4789e with Priority: HIGHEST for action port [ 712.348924] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feef5a96-b442-4e3a-804c-83ebbcb4789e with Priority: HIGHEST for action port [ 712.351212] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-feef5a96-b442-4e3a-804c-83ebbcb4789e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.351556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feef5a96-b442-4e3a-804c-83ebbcb4789e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.351556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feef5a96-b442-4e3a-804c-83ebbcb4789e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.351819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feef5a96-b442-4e3a-804c-83ebbcb4789e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.351911] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feef5a96-b442-4e3a-804c-83ebbcb4789e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.372253] env[66123]: INFO networking_nsxv3.common.synchronization [req-ae6a24ae-3ce2-4bf4-a09e-af9256a7417a req-cc73d3b9-f49e-4201-a60e-ae073236ffec tempest-ServersTestManualDisk-969714279 tempest-ServersTestManualDisk-969714279-project-member] Enqueued Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_members [ 712.372829] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_members [ 712.373210] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.373340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.373410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.373666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.374107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.374107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.374107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.374289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.374289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.374795] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.511837] env[66123]: INFO networking_nsxv3.common.synchronization [req-2578226b-6d75-465f-984d-2ccbd092064c req-a6e626a8-33bb-4ad1-ac06-355c57ebc900 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 712.512259] env[66123]: INFO networking_nsxv3.common.synchronization [req-2578226b-6d75-465f-984d-2ccbd092064c req-a6e626a8-33bb-4ad1-ac06-355c57ebc900 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 712.512391] env[66123]: INFO networking_nsxv3.common.synchronization [req-2578226b-6d75-465f-984d-2ccbd092064c req-a6e626a8-33bb-4ad1-ac06-355c57ebc900 service nova] Enqueued Resource ID: 7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 with Priority: HIGHEST for action port [ 712.513215] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 712.513323] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 712.513425] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 with Priority: HIGHEST for action port [ 712.513799] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.513799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.513905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.514146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.514225] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.515601] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.515735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.515956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.515956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.516416] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.516524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.516589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.516743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.516831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.516925] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.517943] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.518028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.518084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.518228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.518306] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1fbce9-2e85-47ef-a1fa-8e5d92c73183',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.570782] env[66123]: INFO networking_nsxv3.common.synchronization [None req-124d3de7-b372-4ad1-9f48-594b5203f572 None None] Enqueued Resource ID: 4d8032d8-59b5-44ac-b1ca-e3536640e5f6 with Priority: HIGHEST for action port [ 712.571360] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d8032d8-59b5-44ac-b1ca-e3536640e5f6 with Priority: HIGHEST for action port [ 712.571663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d8032d8-59b5-44ac-b1ca-e3536640e5f6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.571942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d8032d8-59b5-44ac-b1ca-e3536640e5f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.571942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d8032d8-59b5-44ac-b1ca-e3536640e5f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.572896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d8032d8-59b5-44ac-b1ca-e3536640e5f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.572896] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d8032d8-59b5-44ac-b1ca-e3536640e5f6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.787929] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.831181] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.831181] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-260" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.831181] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-260" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.831181] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-260" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.831181] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.831761] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.832027] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.832453] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.832689] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.833237] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.833459] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.833708] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.833936] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.834198] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.836018] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.836018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.854762] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port feef5a96-b442-4e3a-804c-83ebbcb4789e [ 712.855172] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.855474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.855628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.855907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.856770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.856770] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:feef5a96-b442-4e3a-804c-83ebbcb4789e already deleted. [ 712.856770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feef5a96-b442-4e3a-804c-83ebbcb4789e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.866516] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.866516] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.866516] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.866516] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-260" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.866516] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-03f8a0e7-a0f1-4299-b67d-55308c9e157a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.866516] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.866516] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.866999] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.867251] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f8a0e7-a0f1-4299-b67d-55308c9e157a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.876641] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.876798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.876858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.877078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.877164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.877366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.877460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.877524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.877677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.877751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.877835] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 already deleted. [ 712.878314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.020761] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.022165] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.023034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.023034] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 with status ACTIVE [ 713.023194] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.023385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.023498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.023823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.023957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.024876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.024876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.024876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.025230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.025230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.025291] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.025463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.025601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.025757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.026464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.026464] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f1fbce9-2e85-47ef-a1fa-8e5d92c73183 is going to be updated. [ 713.052201] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.052450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.052561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.052871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.053133] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.053407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f1fbce9-2e85-47ef-a1fa-8e5d92c73183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.075563] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d8032d8-59b5-44ac-b1ca-e3536640e5f6 [ 713.075638] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.075962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.075962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.076061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.076139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.076229] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d8032d8-59b5-44ac-b1ca-e3536640e5f6 already deleted. [ 713.076307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d8032d8-59b5-44ac-b1ca-e3536640e5f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.238798] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.238798] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.238798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.238798] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.292576] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.293170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.293369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.293836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.294367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.294599] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b is going to be created. [ 713.322927] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.322927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.322927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.323573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.324030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.336247] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b in Status: UNINITIALIZED for 2s [ 713.370684] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.370909] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.371064] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.371399] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.371554] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.371794] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 03f8a0e7-a0f1-4299-b67d-55308c9e157a not found, creating... [ 713.372130] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.372298] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.372411] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.372641] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.372824] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.373454] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.373722] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.373898] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.374258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.374506] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.374727] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 03f8a0e7-a0f1-4299-b67d-55308c9e157a is going to be created. [ 713.400140] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.400375] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.400474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.401040] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.401280] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.401613] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.528549] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.564679] env[66123]: INFO networking_nsxv3.common.synchronization [req-76e0f71f-2388-4fd6-8d65-b61fef31a03a req-f10a0866-2336-4a4a-a306-d26b24a84660 tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 713.565220] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 713.565520] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.565638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.565702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.565900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.566059] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.566158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.566216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.566362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.566444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.566580] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.741701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.741949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.742011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.742430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.742717] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.742910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.743095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.743325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.743483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.743649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.743960] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.744149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.744257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.744495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.744726] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.744875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.744980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.745219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.745699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.745699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.745699] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.031175] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.031641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.031641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.031641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.031784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.031830] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be created. [ 714.061335] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.061549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.061646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.062026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.062026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.071946] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.074919] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: UNINITIALIZED for 2s [ 714.078834] env[66123]: INFO networking_nsxv3.common.synchronization [req-ae6a24ae-3ce2-4bf4-a09e-af9256a7417a req-3dac985b-f61a-48a8-920e-a7bb2c69262f service nova] Enqueued Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_rules [ 714.079164] env[66123]: INFO networking_nsxv3.common.synchronization [req-ae6a24ae-3ce2-4bf4-a09e-af9256a7417a req-3dac985b-f61a-48a8-920e-a7bb2c69262f service nova] Enqueued Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_members [ 714.079453] env[66123]: INFO networking_nsxv3.common.synchronization [req-ae6a24ae-3ce2-4bf4-a09e-af9256a7417a req-3dac985b-f61a-48a8-920e-a7bb2c69262f service nova] Enqueued Resource ID: 03f8a0e7-a0f1-4299-b67d-55308c9e157a with Priority: HIGHEST for action port [ 714.085881] env[66123]: INFO networking_nsxv3.common.synchronization [req-76e0f71f-2388-4fd6-8d65-b61fef31a03a req-a59acdc6-f34f-4e33-808f-3d8e52c28994 tempest-ServersTestMultiNic-1474177665 tempest-ServersTestMultiNic-1474177665-project-member] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 714.085881] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_rules [ 714.085881] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f8a0e7-a0f1-4299-b67d-55308c9e157a with Priority: HIGHEST for action port [ 714.085881] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_members [ 714.085881] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGHEST for action security_group_members [ 714.085881] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.086391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.086561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.087138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.087983] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.089188] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f8a0e7-a0f1-4299-b67d-55308c9e157a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.089647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.089889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.090262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.090413] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f8a0e7-a0f1-4299-b67d-55308c9e157a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.092081] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.094024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.094024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.094024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.094024] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.094024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.094024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.094024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.094024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.094024] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.094778] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.095048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.248644] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c: rpc.has_security_group_logging(os_id): False [ 714.287348] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.287606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.289668] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.289668] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.289668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.290089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.290089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.294020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.294020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.294020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.294020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.294020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.294020] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be created. [ 714.367177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.367494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.367638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.367930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.370159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.381855] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 714.575163] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.595736] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03f8a0e7-a0f1-4299-b67d-55308c9e157a with status ACTIVE [ 714.595956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.596104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.596175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.596387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.596488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.596672] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.596771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.596832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.596981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.597079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.597274] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.597417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.597483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.597660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.597742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.597828] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03f8a0e7-a0f1-4299-b67d-55308c9e157a is going to be updated. [ 714.598972] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.599115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.599348] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.620104] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.620267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.620343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.620515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.620672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.620828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f8a0e7-a0f1-4299-b67d-55308c9e157a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.078470] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.078739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.078739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.079012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.079012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.079079] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 715.102713] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.111658] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.113039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.113039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.113237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.113366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.123493] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 715.345818] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b in Status: SUCCESS [ 715.346071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.346215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.346438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.346712] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.346929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.346929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.347078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.347179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.347269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.347361] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.607666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.607908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.607908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.609304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.609304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.609304] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 is going to be created. [ 715.641316] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.641316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.641545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.641778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.642082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.655016] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 in Status: UNINITIALIZED for 2s [ 715.849775] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a1c9505-3726-4617-ab67-cc7b3b1e107b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.850089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.850178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.850778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.850849] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.851127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.851217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.851500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.851661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.851986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.852220] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a1c9505-3726-4617-ab67-cc7b3b1e107b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.852370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.852445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.852625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.853416] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.853416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.853416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.853416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.853416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.853736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.853736] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.087105] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 716.087509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.087576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.087816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.088155] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.088347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.088419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.088595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.088677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.088822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.088994] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.356846] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a1c9505-3726-4617-ab67-cc7b3b1e107b: rpc.has_security_group_logging(os_id): False [ 716.376356] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.376569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.376622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.376895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.377047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.377275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.377369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.377434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.377586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.377664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.377844] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.377924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.377985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.378156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.378245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.378472] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.378588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.378630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.378747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.378822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.378905] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b is going to be created. [ 716.397125] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 716.397125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.441700] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.441798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.441871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.442234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.442422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.453858] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b in Status: IN_PROGRESS for 2s [ 716.594026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.594026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.594026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.594026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.594026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.594705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.594705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.594705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.594705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.594705] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.097404] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae4b87ee-cc63-4241-b970-23c1a58e9362: rpc.has_security_group_logging(os_id): False [ 717.116918] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.117086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.117340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.117777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.117777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.117926] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.118048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.118123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.118276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.118360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.118575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.118703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.118799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.119501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.119501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.120420] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.120420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.120420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.120420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.120420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.120420] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be created. [ 717.135065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 717.135065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.135065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.135200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.135770] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.135770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.135770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.135770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.135956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.135956] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.232837] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.232837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.233153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.233255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.233447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.247937] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 717.641184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.641184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.641184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.641184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.641184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.641184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.641512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.641512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.641512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.641605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.641931] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be updated. [ 717.672022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 in Status: SUCCESS [ 717.672022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.672022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.672022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.672022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.672022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.672022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.672022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.673198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.673198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.673198] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.695745] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.695745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.696065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.696380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.696584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.711212] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: IN_PROGRESS for 2s [ 718.176751] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.473524] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b in Status: SUCCESS [ 718.473797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.679663] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e957e33-aa0d-4a2f-94eb-3cebae587fb7: rpc.has_security_group_logging(os_id): False [ 718.703619] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.704625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.704756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.705127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.705266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.705684] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.705845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.706030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.706895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.706895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.706895] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 is going to be created. [ 718.792662] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.792817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.792877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.793165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.793350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.816556] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 in Status: IN_PROGRESS for 2s [ 719.086254] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 719.086382] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 719.261099] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 719.261577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.727663] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 in Status: SUCCESS [ 719.727950] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 deletion is rescheduled due to dependency. [ 719.728057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.831168] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 in Status: SUCCESS [ 720.831569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.348467] env[66123]: INFO networking_nsxv3.common.synchronization [req-5cd3df01-d0e8-4635-920e-62c12a0b2e76 req-1029a253-a755-4cd4-bb78-c1936393f33a tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 721.350809] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 721.353312] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.353735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.353909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.356554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.356834] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.356994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.357109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.357324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.357449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.357622] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.860753] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.863994] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.863994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.863994] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be updated. [ 721.896038] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.896038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.896038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.896038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.896380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.907847] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 722.547939] env[66123]: INFO networking_nsxv3.common.synchronization [None req-0bb1fb23-d9cc-4bdd-ac5e-b85a028d7f26 None None] Enqueued Resource ID: b52a2e23-d402-4279-887d-5a3875cbe2d6 with Priority: HIGHEST for action port [ 722.548728] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b52a2e23-d402-4279-887d-5a3875cbe2d6 with Priority: HIGHEST for action port [ 722.549062] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b52a2e23-d402-4279-887d-5a3875cbe2d6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.549226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b52a2e23-d402-4279-887d-5a3875cbe2d6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.549271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b52a2e23-d402-4279-887d-5a3875cbe2d6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.549534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b52a2e23-d402-4279-887d-5a3875cbe2d6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.549600] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b52a2e23-d402-4279-887d-5a3875cbe2d6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.054758] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b52a2e23-d402-4279-887d-5a3875cbe2d6 [ 723.054758] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.054758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.054758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.054758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.054758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.054758] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b52a2e23-d402-4279-887d-5a3875cbe2d6 already deleted. [ 723.054758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b52a2e23-d402-4279-887d-5a3875cbe2d6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.387720] env[66123]: INFO networking_nsxv3.common.synchronization [req-d26b43b4-7d69-4172-b28f-afb9c519012d req-e14aafb5-7e19-4aca-8f36-82f41b03c565 tempest-FloatingIPsAssociationNegativeTestJSON-1887836827 tempest-FloatingIPsAssociationNegativeTestJSON-1887836827-project-member] Enqueued Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_members [ 723.391023] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGHEST for action security_group_members [ 723.391023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.391023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.391023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.391023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.391023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.391023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.391023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.391023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.391023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.391023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.823208] env[66123]: INFO networking_nsxv3.common.synchronization [req-1d8ed7fa-a2fe-4521-8d66-53f22d2780b4 req-ad5c3459-8af8-4e19-af72-e68b179615e2 tempest-ServerAddressesTestJSON-610460707 tempest-ServerAddressesTestJSON-610460707-project-member] Enqueued Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_members [ 723.823536] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_members [ 723.823905] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.824082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.824210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.824475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.824633] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.824739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.824841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.825056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.825151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.825245] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.893390] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.893571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.893657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.893854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.893975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.894242] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.894352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.894417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.894587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.894686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.894779] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 is going to be updated. [ 723.918811] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 723.918811] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 deletion is rescheduled due to dependency. [ 723.918811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.930698] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.933018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.933018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.933018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.933018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.941919] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 in Status: IN_PROGRESS for 2s [ 724.328420] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.328824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.328824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.329188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.329188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.329263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.329403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.329468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.329623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.329701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.329785] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 already deleted. [ 724.329868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.580604] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.580604] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-660" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.580604] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-660" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.580865] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-660" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.581138] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.581290] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.581402] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.581616] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.581770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.581973] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.583305] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.583746] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.583746] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.583746] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.583841] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.583977] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.588048] env[66123]: INFO networking_nsxv3.common.synchronization [None req-f80cb690-6ad3-4930-bf20-7f362bad5d21 None None] Enqueued Resource ID: 1b3fa5fa-4195-42e3-9c08-072edf01f129 with Priority: HIGHEST for action port [ 724.589120] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3fa5fa-4195-42e3-9c08-072edf01f129 with Priority: HIGHEST for action port [ 724.590690] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b3fa5fa-4195-42e3-9c08-072edf01f129 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.590690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b3fa5fa-4195-42e3-9c08-072edf01f129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.590690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b3fa5fa-4195-42e3-9c08-072edf01f129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.591214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b3fa5fa-4195-42e3-9c08-072edf01f129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.591214] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b3fa5fa-4195-42e3-9c08-072edf01f129',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.610362] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.610532] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.610667] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.610844] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-660" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.611276] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-4654fb37-c341-4bf6-a2fc-eb1f35921a73 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.611464] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.611580] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.611890] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.612145] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4654fb37-c341-4bf6-a2fc-eb1f35921a73',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.986248] env[66123]: INFO networking_nsxv3.common.synchronization [None req-a0f65ae6-9ea0-47be-9590-59d1b9019962 None None] Enqueued Resource ID: 920bccc8-57a9-4044-a04c-619e9a8b96da with Priority: HIGHEST for action port [ 724.987271] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920bccc8-57a9-4044-a04c-619e9a8b96da with Priority: HIGHEST for action port [ 724.987571] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-920bccc8-57a9-4044-a04c-619e9a8b96da taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.987705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-920bccc8-57a9-4044-a04c-619e9a8b96da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.987764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-920bccc8-57a9-4044-a04c-619e9a8b96da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.988016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-920bccc8-57a9-4044-a04c-619e9a8b96da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.988090] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('920bccc8-57a9-4044-a04c-619e9a8b96da',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.093894] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b3fa5fa-4195-42e3-9c08-072edf01f129 [ 725.094203] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.094375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.094467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.094731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.094856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.095176] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b3fa5fa-4195-42e3-9c08-072edf01f129 already deleted. [ 725.095176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b3fa5fa-4195-42e3-9c08-072edf01f129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.115149] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.115382] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.115502] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.115845] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.116078] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.116175] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 4654fb37-c341-4bf6-a2fc-eb1f35921a73 not found, creating... [ 725.116428] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.116915] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.116915] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.118238] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.118313] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.118828] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.118828] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.119206] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.119206] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.119206] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.119359] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 4654fb37-c341-4bf6-a2fc-eb1f35921a73 is going to be created. [ 725.141449] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.141663] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.141780] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.142092] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.142346] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.142573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.490229] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 920bccc8-57a9-4044-a04c-619e9a8b96da [ 725.490533] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.490729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.490777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.491276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.491427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.491550] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:920bccc8-57a9-4044-a04c-619e9a8b96da already deleted. [ 725.491665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-920bccc8-57a9-4044-a04c-619e9a8b96da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.894718] env[66123]: INFO networking_nsxv3.common.synchronization [req-1d8ed7fa-a2fe-4521-8d66-53f22d2780b4 req-1637386d-7f1c-4a31-ac14-2ec05a3d18e4 service nova] Enqueued Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_rules [ 725.894887] env[66123]: INFO networking_nsxv3.common.synchronization [req-1d8ed7fa-a2fe-4521-8d66-53f22d2780b4 req-1637386d-7f1c-4a31-ac14-2ec05a3d18e4 service nova] Enqueued Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_members [ 725.895027] env[66123]: INFO networking_nsxv3.common.synchronization [req-1d8ed7fa-a2fe-4521-8d66-53f22d2780b4 req-1637386d-7f1c-4a31-ac14-2ec05a3d18e4 service nova] Enqueued Resource ID: 4654fb37-c341-4bf6-a2fc-eb1f35921a73 with Priority: HIGHEST for action port [ 725.895572] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_rules [ 725.895753] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_members [ 725.895801] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4654fb37-c341-4bf6-a2fc-eb1f35921a73 with Priority: HIGHEST for action port [ 725.896135] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.896265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.896332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.896573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.896659] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.899251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.899251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.899251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.899251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.899251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.899251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.899251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.899251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.899251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.899251] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.899708] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4654fb37-c341-4bf6-a2fc-eb1f35921a73 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.899708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.899793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.900446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.900446] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4654fb37-c341-4bf6-a2fc-eb1f35921a73',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.952797] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 in Status: SUCCESS [ 725.954143] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 deletion is rescheduled due to dependency. [ 725.954143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.401659] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.402732] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.402876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.404551] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4654fb37-c341-4bf6-a2fc-eb1f35921a73 with status ACTIVE [ 726.404551] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.404657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.405023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.405023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.405023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.405439] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.405439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.405439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.405593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.405593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.405842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.405842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.406111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.406111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.406111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.406378] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4654fb37-c341-4bf6-a2fc-eb1f35921a73 is going to be updated. [ 726.428750] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.428750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.428947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.429160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.429272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.429445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4654fb37-c341-4bf6-a2fc-eb1f35921a73" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.805870] env[66123]: INFO networking_nsxv3.common.synchronization [None req-49606537-dd98-4efc-83ab-0a5f76730cca None None] Enqueued Resource ID: 98a23994-9a4a-4b6f-8736-ee009ee9b2f6 with Priority: HIGHEST for action port [ 726.806401] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a23994-9a4a-4b6f-8736-ee009ee9b2f6 with Priority: HIGHEST for action port [ 726.806940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-98a23994-9a4a-4b6f-8736-ee009ee9b2f6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.806940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98a23994-9a4a-4b6f-8736-ee009ee9b2f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.806940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98a23994-9a4a-4b6f-8736-ee009ee9b2f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.807182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98a23994-9a4a-4b6f-8736-ee009ee9b2f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.807488] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98a23994-9a4a-4b6f-8736-ee009ee9b2f6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.904770] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.951114] env[66123]: INFO networking_nsxv3.common.synchronization [req-12259193-1b4e-49fe-88a3-86ffbcdb7742 req-00613b5d-0db4-4f58-9ab5-a8de250e8e0c tempest-ServerMetadataTestJSON-1747236582 tempest-ServerMetadataTestJSON-1747236582-project-member] Enqueued Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_members [ 726.951781] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_members [ 726.952886] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.952886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.952886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.952886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.953131] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.953417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.953417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.953562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.953684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.953812] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.310155] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98a23994-9a4a-4b6f-8736-ee009ee9b2f6 [ 727.310599] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.310907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.311121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.311494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.311583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.315024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98a23994-9a4a-4b6f-8736-ee009ee9b2f6 already deleted. [ 727.315024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98a23994-9a4a-4b6f-8736-ee009ee9b2f6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.408333] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.408543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.409415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.409415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.409415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.409415] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 is going to be created. [ 727.445558] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.445772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.445772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.445998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.446204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.450501] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.450655] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-313" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.450713] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-313" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.451046] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-313" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.451368] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.451528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.451659] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.451893] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.452154] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.452726] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.452726] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.452726] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.452726] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.452726] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.452941] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.452995] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.457681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.457812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.457890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.458066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.458159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.458366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.458479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.458543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.458708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.458802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.458879] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d already deleted. [ 727.458975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.460575] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 in Status: UNINITIALIZED for 2s [ 727.482513] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.482695] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.482847] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.483092] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-313" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.483510] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-eec4749e-f843-46fd-9446-ecc56591fa70 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.483766] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.483954] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.484363] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.484509] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eec4749e-f843-46fd-9446-ecc56591fa70',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.987837] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.988221] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.988221] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.988589] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.988795] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.989018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port eec4749e-f843-46fd-9446-ecc56591fa70 not found, creating... [ 727.989399] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.989622] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.989819] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.990130] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.990330] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.990726] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.990983] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.991152] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.991438] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.991625] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.991818] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: eec4749e-f843-46fd-9446-ecc56591fa70 is going to be created. [ 727.995771] env[66123]: INFO networking_nsxv3.common.synchronization [req-8b9d5c25-b624-4f22-959c-cff4fee4ccbc req-8fd59483-1e7f-4c49-9813-b2259609315a tempest-FloatingIPsAssociationTestJSON-1710505517 tempest-FloatingIPsAssociationTestJSON-1710505517-project-member] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 727.996904] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGHEST for action security_group_members [ 727.997156] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.997266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.997335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.997499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.997644] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.997739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.997802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.997971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.998048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.998112] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.018321] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.018612] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.018895] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.019175] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.019529] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.019841] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.499785] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.499951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.500041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.500272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.500361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.500593] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.500698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.500759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.500909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.500982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.501262] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be updated. [ 728.534211] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.534365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.534436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.534671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.534814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.546358] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: IN_PROGRESS for 2s [ 728.840304] env[66123]: INFO networking_nsxv3.common.synchronization [req-12259193-1b4e-49fe-88a3-86ffbcdb7742 req-704db657-ef7d-4b87-8ccc-b6ade97ee0ce service nova] Enqueued Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_rules [ 728.840501] env[66123]: INFO networking_nsxv3.common.synchronization [req-12259193-1b4e-49fe-88a3-86ffbcdb7742 req-704db657-ef7d-4b87-8ccc-b6ade97ee0ce service nova] Enqueued Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_members [ 728.840632] env[66123]: INFO networking_nsxv3.common.synchronization [req-12259193-1b4e-49fe-88a3-86ffbcdb7742 req-704db657-ef7d-4b87-8ccc-b6ade97ee0ce service nova] Enqueued Resource ID: eec4749e-f843-46fd-9446-ecc56591fa70 with Priority: HIGHEST for action port [ 728.841190] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_rules [ 728.841339] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_members [ 728.841585] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eec4749e-f843-46fd-9446-ecc56591fa70 with Priority: HIGHEST for action port [ 728.841973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.842114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.842182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.842434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.842530] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.843437] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.843557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.843624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.843793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.843941] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.844052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.844122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.844288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.844377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.844467] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.847538] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-eec4749e-f843-46fd-9446-ecc56591fa70 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.847538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.847538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.847538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.847538] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eec4749e-f843-46fd-9446-ecc56591fa70',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.190614] env[66123]: INFO networking_nsxv3.common.synchronization [req-fb6070e3-57a6-4c60-955e-666d3a545208 req-7a73a3d0-a1c2-4fc7-80bc-b576ec6b923f tempest-MigrationsAdminTest-723267321 tempest-MigrationsAdminTest-723267321-project-member] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 729.191929] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 729.191929] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.191929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.191929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.193470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.193671] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.193792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.193877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.194172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.194312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.194833] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.349153] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.350453] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.350453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.354041] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eec4749e-f843-46fd-9446-ecc56591fa70 with status ACTIVE [ 729.354041] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.354041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.354041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.354404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.354404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.354404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.354517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.354517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.354912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.354912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.355112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.355112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.355112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.355910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.355910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.355910] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eec4749e-f843-46fd-9446-ecc56591fa70 is going to be updated. [ 729.380137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.380336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.380431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.380711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.380894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.381274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eec4749e-f843-46fd-9446-ecc56591fa70" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.472245] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 in Status: SUCCESS [ 729.472344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.473461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.473461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.473461] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.473461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.473461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.473461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.473461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.473461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.473813] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.685826] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.687282] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.687401] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.687735] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.688165] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.688596] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.688596] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.688705] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.688829] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.689098] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.689223] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.689344] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.689451] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.689869] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.689869] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.689869] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.696795] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.712079] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.712539] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.712539] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.712670] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.714546] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-9c63d343-c931-449f-b2f2-f492b12a79ba taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.714546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.714546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.715305] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.715305] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c63d343-c931-449f-b2f2-f492b12a79ba',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.851977] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.978550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.978804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.978804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.979224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.979480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.979688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.979856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.979999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.980130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.980301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.980537] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.980716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.980818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.981076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.981362] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.981487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.981592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.981809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.981955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.982180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.982263] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.200795] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.220801] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.220801] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 9c63d343-c931-449f-b2f2-f492b12a79ba not found, creating... [ 730.220801] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.220801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.221396] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.221396] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.221396] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.221554] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.221788] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.222346] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 9c63d343-c931-449f-b2f2-f492b12a79ba is going to be created. [ 730.243208] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.243490] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.243554] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.243809] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.244074] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.244303] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.358425] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.358425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.358425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.358425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.358425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.358425] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d is going to be created. [ 730.403287] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.403287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.403287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.403287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.403287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.419749] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d in Status: UNINITIALIZED for 2s [ 730.485024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86c8a328-51f3-46d6-a72c-f22aefa2fcf2: rpc.has_security_group_logging(os_id): False [ 730.510501] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.510757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.510757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.511157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.511157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.511481] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.511539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.511630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.511862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.511913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.512172] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.512290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.512359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.512546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.512680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.512870] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.513031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.513685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.513905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.513988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.514115] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 is going to be created. [ 730.557519] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 in Status: SUCCESS [ 730.557519] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 deletion is rescheduled due to dependency. [ 730.557519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.579779] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.579942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.579991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.580243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.580431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.594662] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 in Status: IN_PROGRESS for 2s [ 730.703679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.703679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.703679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.703679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.705101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.705101] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be updated. [ 730.743971] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.748809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.748809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.748809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.748809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.758718] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: IN_PROGRESS for 2s [ 730.894305] env[66123]: INFO networking_nsxv3.common.synchronization [None req-9c4231f2-9a47-49bb-8cb6-915b1de2e5a2 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 730.894305] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 730.894305] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.894305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.894305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.894305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.894305] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.136093] env[66123]: INFO networking_nsxv3.common.synchronization [req-fb6070e3-57a6-4c60-955e-666d3a545208 req-b20aee81-08d6-4232-9418-ae4f511d002b service nova] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_rules [ 731.136270] env[66123]: INFO networking_nsxv3.common.synchronization [req-fb6070e3-57a6-4c60-955e-666d3a545208 req-b20aee81-08d6-4232-9418-ae4f511d002b service nova] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 731.136396] env[66123]: INFO networking_nsxv3.common.synchronization [req-fb6070e3-57a6-4c60-955e-666d3a545208 req-b20aee81-08d6-4232-9418-ae4f511d002b service nova] Enqueued Resource ID: 9c63d343-c931-449f-b2f2-f492b12a79ba with Priority: HIGHEST for action port [ 731.136938] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_rules [ 731.138788] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 731.138788] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c63d343-c931-449f-b2f2-f492b12a79ba with Priority: HIGHEST for action port [ 731.138958] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.141241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.141339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.141560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.141648] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.142643] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.142749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.142948] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c63d343-c931-449f-b2f2-f492b12a79ba taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.143060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.143145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.143387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.143425] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c63d343-c931-449f-b2f2-f492b12a79ba',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.204913] env[66123]: INFO networking_nsxv3.common.synchronization [None req-cd8b47a9-a0ab-46a5-8bec-be3bafdab82c tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 731.205312] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 731.205638] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.205815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.419286] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.419529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.419529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.420627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.420627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.420627] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f already deleted. [ 731.420627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.420627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.420627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.420627] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.645860] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.645860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.649132] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c63d343-c931-449f-b2f2-f492b12a79ba with status ACTIVE [ 731.649349] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.649486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.649569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.649751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.649941] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.650148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.650269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.650354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.650480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.650607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.650845] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.650845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.651127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.651127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.651127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.651481] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c63d343-c931-449f-b2f2-f492b12a79ba is going to be updated. [ 731.677465] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.677666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.677846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.678041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.678189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.678375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c63d343-c931-449f-b2f2-f492b12a79ba" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.942662] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.943603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.943603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.943603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.943802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.943802] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f already deleted. [ 731.943888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.429839] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d in Status: SUCCESS [ 732.430219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.430219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.430441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.430663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.430799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.430866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.431055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.431138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.431226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.431315] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.481399] env[66123]: INFO networking_nsxv3.common.synchronization [None req-57a88092-af68-4647-a678-556c826a5b74 tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: de3ad093-1c14-4337-9fa6-02a40a1de69b with Priority: HIGHEST for action security_group_rules [ 732.481745] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de3ad093-1c14-4337-9fa6-02a40a1de69b with Priority: HIGHEST for action security_group_rules [ 732.485066] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de3ad093-1c14-4337-9fa6-02a40a1de69b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.485204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.485318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.485498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.485590] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de3ad093-1c14-4337-9fa6-02a40a1de69b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.613173] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 in Status: SUCCESS [ 732.613482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.635284] env[66123]: INFO networking_nsxv3.common.synchronization [None req-a0515baa-e12a-445d-a8dd-5bcae9b92119 tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: de3ad093-1c14-4337-9fa6-02a40a1de69b with Priority: HIGHEST for action security_group_rules [ 732.635284] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de3ad093-1c14-4337-9fa6-02a40a1de69b with Priority: HIGHEST for action security_group_rules [ 732.635701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de3ad093-1c14-4337-9fa6-02a40a1de69b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.635814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.770535] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: SUCCESS [ 732.770825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.771158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.771636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.771722] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.772124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.772124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.772258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.772393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.773249] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.934434] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.934728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.934808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.935097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.935344] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.935425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.935482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.935621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.935704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.935788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.935944] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.936058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.936127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.936609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.936609] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.936609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.936845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.936845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.936939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.936981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.937076] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.011415] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.011582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.011825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.011923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.011972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.012094] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de3ad093-1c14-4337-9fa6-02a40a1de69b already deleted. [ 733.012180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.012346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.012512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.012597] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de3ad093-1c14-4337-9fa6-02a40a1de69b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.276374] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.441516] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e136940d-8ffe-47bc-b8b9-42f22d7b072d: rpc.has_security_group_logging(os_id): False [ 733.458446] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.458824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.458985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.459469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.459701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.460160] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.460410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.460583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.460850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.461143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.461603] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.464269] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.464269] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d is going to be created. [ 733.533034] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.533034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.533034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.533034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.533034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.542115] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.542115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.542115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.542115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.542115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.542115] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de3ad093-1c14-4337-9fa6-02a40a1de69b already deleted. [ 733.542115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de3ad093-1c14-4337-9fa6-02a40a1de69b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.547595] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d in Status: IN_PROGRESS for 2s [ 733.778014] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.280525] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.280778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.280845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.281135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.281269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.281373] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be updated. [ 734.312385] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.312470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.312525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.314473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.314473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.324731] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: IN_PROGRESS for 2s [ 735.563562] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d in Status: SUCCESS [ 735.563944] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.339339] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: SUCCESS [ 736.339677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.339924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.340418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.340498] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.340625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.340711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.340934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.341545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.341671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.341807] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.847260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.847260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.847260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.847260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.847895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.847895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.847895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.847895] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.847895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.847895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.848170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.848170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.848170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.848256] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.355175] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56: rpc.has_security_group_logging(os_id): False [ 737.375959] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.376714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.379026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.379026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.379026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.382510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.382510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.382510] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.382510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.382510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.382510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.382510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.382510] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be updated. [ 737.455974] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.455974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.455974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.455974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.455974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.472198] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: IN_PROGRESS for 2s [ 737.636053] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 737.636277] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 738.043869] env[66123]: INFO networking_nsxv3.common.synchronization [req-33142d41-2078-4184-9c90-92d2e517f009 req-7fa6e357-2252-48a3-80f2-1b8f835e15dd tempest-ServersNegativeTestJSON-927005488 tempest-ServersNegativeTestJSON-927005488-project-member] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 738.044534] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 738.044851] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.045068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.045068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.045286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.045447] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.045593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.045650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.045780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.045852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.045958] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.549467] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.729896] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.730123] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.730246] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.730507] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.730757] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.730923] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.731108] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.731316] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.731455] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.731661] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.731765] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.731862] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.731958] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.732101] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.732203] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.732330] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.753824] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.754027] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.754199] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.754350] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.754725] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-288f076a-063d-4eba-a054-3394a02eb08d taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.754925] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.755093] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.755459] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.755618] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('288f076a-063d-4eba-a054-3394a02eb08d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.050580] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.205261] env[66123]: INFO networking_nsxv3.common.synchronization [req-fb20993d-b15f-45e6-870e-b90982db3962 req-9b9ce103-34c1-4313-a3bc-6a72c151d17b tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 739.205733] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 739.206046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.206167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.206235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.206435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.206599] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.206675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.206754] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.206874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.206963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.207242] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.258781] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.258987] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.259125] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.259399] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.259545] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.259694] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 288f076a-063d-4eba-a054-3394a02eb08d not found, creating... [ 739.259945] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.260148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.260362] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.260489] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.260622] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.260892] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.261063] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.261231] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.261455] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.261557] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.261689] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 288f076a-063d-4eba-a054-3394a02eb08d is going to be created. [ 739.282352] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.282553] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.282676] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.282939] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.283274] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.283623] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.489371] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: SUCCESS [ 739.490141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.554260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.554374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.554414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.554985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.554985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.554985] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be updated. [ 739.587644] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.587775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.587775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.587987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.588152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.597705] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 739.711056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.711277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.711375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.711660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.711787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.712112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.712455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.712455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.712563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.712613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.712719] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 739.755051] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.755254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.755287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.755517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.755622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.768171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 740.020750] env[66123]: INFO networking_nsxv3.common.synchronization [req-33142d41-2078-4184-9c90-92d2e517f009 req-3771b077-d873-47e8-9d77-05e9d0ddfbeb service nova] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_rules [ 740.020750] env[66123]: INFO networking_nsxv3.common.synchronization [req-33142d41-2078-4184-9c90-92d2e517f009 req-3771b077-d873-47e8-9d77-05e9d0ddfbeb service nova] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 740.020839] env[66123]: INFO networking_nsxv3.common.synchronization [req-33142d41-2078-4184-9c90-92d2e517f009 req-3771b077-d873-47e8-9d77-05e9d0ddfbeb service nova] Enqueued Resource ID: 288f076a-063d-4eba-a054-3394a02eb08d with Priority: HIGHEST for action port [ 740.021469] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_rules [ 740.021687] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 740.021822] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288f076a-063d-4eba-a054-3394a02eb08d with Priority: HIGHEST for action port [ 740.022186] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.022599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.022599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.022810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.022949] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.023972] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.024121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.024834] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-288f076a-063d-4eba-a054-3394a02eb08d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.024834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.024834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.024834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.025944] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('288f076a-063d-4eba-a054-3394a02eb08d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.428867] env[66123]: INFO networking_nsxv3.common.synchronization [req-8ee42fd3-d6f7-4a49-9bc6-403aab502099 req-fcd5bdae-62e4-4540-abde-0c05cef92f36 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 740.429441] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 740.429797] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.429953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.430053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.430305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.430467] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.430569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.430633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.430786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.430872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.430961] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.527267] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.527430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.527527] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 288f076a-063d-4eba-a054-3394a02eb08d with status ACTIVE [ 740.527723] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.527878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.527951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.528174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.528266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.528451] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.528563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.528627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.528765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.528843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.529030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.529148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.529183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.529307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.529414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.529459] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 288f076a-063d-4eba-a054-3394a02eb08d is going to be updated. [ 740.554865] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.555030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.555122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.555389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.555553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.555744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-288f076a-063d-4eba-a054-3394a02eb08d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.934994] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.934994] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.934994] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de already deleted. [ 740.934994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.203054] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.203297] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.203443] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.203739] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.203990] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.206258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.206382] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.206622] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.206752] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.206948] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.207067] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.207172] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.207276] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.207384] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.207480] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.207605] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.227570] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.227745] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.227859] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.228041] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.228361] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-ea97fe6d-1870-4774-a746-2c81ac2f2244 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.228620] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.228620] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.229363] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.229363] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea97fe6d-1870-4774-a746-2c81ac2f2244',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.598778] env[66123]: INFO networking_nsxv3.common.synchronization [None req-bd482290-92df-4dd0-b1ba-b7a145adeb82 None None] Enqueued Resource ID: b948a2f7-d3a5-49b1-8073-fcab5c632d21 with Priority: HIGHEST for action port [ 741.600815] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b948a2f7-d3a5-49b1-8073-fcab5c632d21 with Priority: HIGHEST for action port [ 741.601145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b948a2f7-d3a5-49b1-8073-fcab5c632d21 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.601269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b948a2f7-d3a5-49b1-8073-fcab5c632d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.601340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b948a2f7-d3a5-49b1-8073-fcab5c632d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.601622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b948a2f7-d3a5-49b1-8073-fcab5c632d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.601717] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b948a2f7-d3a5-49b1-8073-fcab5c632d21',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.611824] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 741.612072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.612241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.612463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.612651] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.612769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.612834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.612991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.613086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.613233] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.735360] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.735360] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.735501] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.736081] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.736222] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.736452] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port ea97fe6d-1870-4774-a746-2c81ac2f2244 not found, creating... [ 741.736771] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.736942] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.737105] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.737387] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.737493] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.737821] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.738017] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.738476] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.738800] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.739047] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.739300] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: ea97fe6d-1870-4774-a746-2c81ac2f2244 is going to be created. [ 741.767385] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.767385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.767385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.767689] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.768344] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.768344] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.780988] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 741.781298] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 deletion is rescheduled due to dependency. [ 741.781441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.105211] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b948a2f7-d3a5-49b1-8073-fcab5c632d21 [ 742.105454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.105593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.105654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.105888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.106037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.107069] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b948a2f7-d3a5-49b1-8073-fcab5c632d21 already deleted. [ 742.107069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b948a2f7-d3a5-49b1-8073-fcab5c632d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.116181] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.526565] env[66123]: INFO networking_nsxv3.common.synchronization [req-8ee42fd3-d6f7-4a49-9bc6-403aab502099 req-a16ca90c-5e53-4f68-bd39-8a5e17d80796 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 742.526735] env[66123]: INFO networking_nsxv3.common.synchronization [req-8ee42fd3-d6f7-4a49-9bc6-403aab502099 req-a16ca90c-5e53-4f68-bd39-8a5e17d80796 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 742.526865] env[66123]: INFO networking_nsxv3.common.synchronization [req-8ee42fd3-d6f7-4a49-9bc6-403aab502099 req-a16ca90c-5e53-4f68-bd39-8a5e17d80796 service nova] Enqueued Resource ID: ea97fe6d-1870-4774-a746-2c81ac2f2244 with Priority: HIGHEST for action port [ 742.527410] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 742.527551] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 742.527649] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea97fe6d-1870-4774-a746-2c81ac2f2244 with Priority: HIGHEST for action port [ 742.527922] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.528464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.528559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.529133] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.529343] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.530364] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.530492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.530560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.533372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.533372] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.533372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.533372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.533372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.533372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.533372] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.533372] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea97fe6d-1870-4774-a746-2c81ac2f2244 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.533680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.533680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.533744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.533840] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea97fe6d-1870-4774-a746-2c81ac2f2244',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.619202] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.036722] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.036987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.037090] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.039891] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea97fe6d-1870-4774-a746-2c81ac2f2244 with status ACTIVE [ 743.039891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.039891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.039891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.039891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.039891] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea97fe6d-1870-4774-a746-2c81ac2f2244 is going to be updated. [ 743.071509] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.071509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.071509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.071509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.071509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.071509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea97fe6d-1870-4774-a746-2c81ac2f2244" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.122363] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.122363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.122363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.122363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.122363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.122681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be updated. [ 743.179070] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.179070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.179070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.179070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.179070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.195240] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 743.454514] env[66123]: INFO networking_nsxv3.common.synchronization [req-41d9eb22-4fc8-473a-8d84-20d0bd28ee4d req-55be77c0-f262-484e-9ea9-8a751317b2cb tempest-ServerDiagnosticsNegativeTest-2132658274 tempest-ServerDiagnosticsNegativeTest-2132658274-project-member] Enqueued Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_members [ 743.455875] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_members [ 743.455875] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.455875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.455875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.456260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.456260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.456455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.456560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.456684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.456774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.456856] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.544784] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.959471] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.959769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.959769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.959927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.960055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.960312] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.960424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.960494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.960662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.960744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.960827] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 699b9736-049e-445f-86a2-8de9c9beb0cf already deleted. [ 743.960908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.047687] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.047895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.047970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.048221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.048316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.048422] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be created. [ 744.072507] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.072947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.073095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.073369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.073572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.084711] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: UNINITIALIZED for 2s [ 744.593452] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.593633] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.593758] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.594022] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.594306] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.594464] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.594574] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.594915] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.595112] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.595266] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.595374] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.595476] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.595579] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.595683] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.595782] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.595929] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.616383] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.616545] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.617145] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.617404] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.617847] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.618035] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.618313] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.618662] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.618796] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.696763] env[66123]: INFO networking_nsxv3.common.synchronization [None req-64a42b20-d4a1-4132-bb26-8c81ee05adf5 None None] Enqueued Resource ID: ff17683f-e5f5-4f9f-869c-e0c4993f7fff with Priority: HIGHEST for action port [ 744.696763] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff17683f-e5f5-4f9f-869c-e0c4993f7fff with Priority: HIGHEST for action port [ 744.697869] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff17683f-e5f5-4f9f-869c-e0c4993f7fff taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.697869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff17683f-e5f5-4f9f-869c-e0c4993f7fff" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.697869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff17683f-e5f5-4f9f-869c-e0c4993f7fff" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.698390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff17683f-e5f5-4f9f-869c-e0c4993f7fff" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.698490] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff17683f-e5f5-4f9f-869c-e0c4993f7fff',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.802858] env[66123]: INFO networking_nsxv3.common.synchronization [None req-129de49d-bb49-44bb-bf97-eecaf0678179 None None] Enqueued Resource ID: 15214323-49e8-416c-b0b9-08bf4517b62d with Priority: HIGHEST for action port [ 744.803776] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15214323-49e8-416c-b0b9-08bf4517b62d with Priority: HIGHEST for action port [ 744.803776] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-15214323-49e8-416c-b0b9-08bf4517b62d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.803776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15214323-49e8-416c-b0b9-08bf4517b62d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.803776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15214323-49e8-416c-b0b9-08bf4517b62d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.804014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15214323-49e8-416c-b0b9-08bf4517b62d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.804014] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15214323-49e8-416c-b0b9-08bf4517b62d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.122884] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.123394] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.123720] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.124504] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.124504] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.124504] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 not found, creating... [ 745.124759] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.124867] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.124971] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.125222] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.125352] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.125780] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.125864] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.125914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.126742] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.126880] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.127312] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 is going to be created. [ 745.152798] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.154075] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.154075] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.154549] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.154800] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.155069] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.204422] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff17683f-e5f5-4f9f-869c-e0c4993f7fff [ 745.204660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.205235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.205235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.205235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.205235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.205447] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff17683f-e5f5-4f9f-869c-e0c4993f7fff already deleted. [ 745.205447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff17683f-e5f5-4f9f-869c-e0c4993f7fff" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.210271] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 745.210483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.210910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.211157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.211386] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.211534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.211580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.212763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.212763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.212763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.212763] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.312427] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15214323-49e8-416c-b0b9-08bf4517b62d [ 745.312427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.312427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.312427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.312427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.312427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.312427] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15214323-49e8-416c-b0b9-08bf4517b62d already deleted. [ 745.312427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15214323-49e8-416c-b0b9-08bf4517b62d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.479454] env[66123]: INFO networking_nsxv3.common.synchronization [None req-5e1c4364-086d-4c1c-b559-4b559b8b83d6 None None] Enqueued Resource ID: 26437fdf-8050-43d4-bf8d-b0567c150194 with Priority: HIGHEST for action port [ 745.479821] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26437fdf-8050-43d4-bf8d-b0567c150194 with Priority: HIGHEST for action port [ 745.480620] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-26437fdf-8050-43d4-bf8d-b0567c150194 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.480735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26437fdf-8050-43d4-bf8d-b0567c150194" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.482125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26437fdf-8050-43d4-bf8d-b0567c150194" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.482125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26437fdf-8050-43d4-bf8d-b0567c150194" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.482125] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26437fdf-8050-43d4-bf8d-b0567c150194',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.714834] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.715178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.715582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.715814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.715999] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.716118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.716181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.716363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.716451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.716538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.716718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.716825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.716887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.717045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.717517] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.717517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.717517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.717517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.717517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.717706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.717706] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.935063] env[66123]: INFO networking_nsxv3.common.synchronization [req-41d9eb22-4fc8-473a-8d84-20d0bd28ee4d req-432abfd2-4391-4dfe-a3ae-06e4cfa6a8df service nova] Enqueued Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_rules [ 745.935364] env[66123]: INFO networking_nsxv3.common.synchronization [req-41d9eb22-4fc8-473a-8d84-20d0bd28ee4d req-432abfd2-4391-4dfe-a3ae-06e4cfa6a8df service nova] Enqueued Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_members [ 745.935364] env[66123]: INFO networking_nsxv3.common.synchronization [req-41d9eb22-4fc8-473a-8d84-20d0bd28ee4d req-432abfd2-4391-4dfe-a3ae-06e4cfa6a8df service nova] Enqueued Resource ID: 5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 with Priority: HIGHEST for action port [ 745.935920] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_rules [ 745.936168] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_members [ 745.936228] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 with Priority: HIGHEST for action port [ 745.936489] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.936607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.936657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.936918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.936982] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.938430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.938540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.938602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.939052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.939052] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.939052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.939496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.939496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.939496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.939496] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.941912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.941912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.941912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.941912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.941912] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.983923] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26437fdf-8050-43d4-bf8d-b0567c150194 [ 745.985061] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.985061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.985061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.985061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.985061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.985361] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26437fdf-8050-43d4-bf8d-b0567c150194 already deleted. [ 745.985361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26437fdf-8050-43d4-bf8d-b0567c150194" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.097120] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 746.098042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.098042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.098042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.098042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.098042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.098286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.098286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.098340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.098454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.098491] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.220838] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c: rpc.has_security_group_logging(os_id): False [ 746.246253] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.246484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.246708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.246803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.247011] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.247111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.247172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.247321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.247402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.247590] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.247700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.247742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.247875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.247950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.249648] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.250503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.250503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.250503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.250503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.250503] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be updated. [ 746.317028] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.317028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.317028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.317028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.317028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.331124] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 746.445234] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.445234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.445396] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.446423] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 with status ACTIVE [ 746.446610] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.446725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.446790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.446995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.447129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.447345] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.447460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.447520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.447667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.447740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.447922] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.448029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.448078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.448207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.448330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.448374] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99 is going to be updated. [ 746.500489] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.500489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.500489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.500489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.500489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.500489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b0caba4-72ca-466e-bb6c-3a7f9f8b5f99" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.603863] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.604043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.604123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.604473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.604646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.605084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.605084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.605084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.605084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.605257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.605288] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.605370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.605430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.605618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.605828] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.605828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.605938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.605979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.606065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.606147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.606233] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.655732] env[66123]: INFO networking_nsxv3.common.synchronization [req-b357c6a4-42d1-4efc-a8cf-71c9c7d73894 req-e5db4e1f-62fa-47f7-acae-c68792fbe607 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 746.655960] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 746.656275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.656396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.656603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.657369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.657369] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.657369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.657369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.657369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.657596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.657596] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.865261] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ac959aba-058d-4489-afac-ce5d659f23da None None] Enqueued Resource ID: ac501f0b-9f98-4838-b584-d302546a012f with Priority: HIGHEST for action port [ 746.865826] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac501f0b-9f98-4838-b584-d302546a012f with Priority: HIGHEST for action port [ 746.866233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac501f0b-9f98-4838-b584-d302546a012f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.866357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac501f0b-9f98-4838-b584-d302546a012f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.866424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac501f0b-9f98-4838-b584-d302546a012f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.866706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac501f0b-9f98-4838-b584-d302546a012f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.866792] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac501f0b-9f98-4838-b584-d302546a012f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.952086] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.111029] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b3e626-c03f-466a-b911-e8ab22cc99de: rpc.has_security_group_logging(os_id): False [ 747.138086] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.138086] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.138086] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.138086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.138657] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.138657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.138657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.138657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.138657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.138657] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be created. [ 747.163511] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.163684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.163742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.164049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.164049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.164361] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.164489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.164549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.164706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.164784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.164883] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f already deleted. [ 747.164975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.222356] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.222356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.222356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.222625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.222677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.244299] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 747.369663] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac501f0b-9f98-4838-b584-d302546a012f [ 747.369878] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.370030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.370112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.370344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.370527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.370527] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac501f0b-9f98-4838-b584-d302546a012f already deleted. [ 747.370626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac501f0b-9f98-4838-b584-d302546a012f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.385068] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.385269] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.387055] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.387055] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.387055] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.387055] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.387055] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.387055] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.387055] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.387055] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.387055] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.390234] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.390234] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.390234] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.390234] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.390234] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.411292] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.411292] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.411292] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.411292] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.411292] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-afa035eb-e40e-4188-97ff-f12409a5951e taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.411292] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.411292] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.411292] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.411292] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afa035eb-e40e-4188-97ff-f12409a5951e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.458673] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.458786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.458838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.459071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.459217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.459337] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 699b9736-049e-445f-86a2-8de9c9beb0cf is going to be created. [ 747.490959] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.491151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.491212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.491455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.491628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.506572] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 699b9736-049e-445f-86a2-8de9c9beb0cf in Status: UNINITIALIZED for 2s [ 747.776250] env[66123]: INFO networking_nsxv3.common.synchronization [req-2f0b0736-9a85-4385-829b-bbe268804923 req-0a984542-3f1d-4d73-a84c-e768bdf512e7 tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 747.776250] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 747.776805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.777017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.777095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.777941] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.778130] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.778321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.778321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.778511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.778830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.778830] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.782297] env[66123]: INFO networking_nsxv3.common.synchronization [None req-3ee36b2b-eedf-4ce5-9509-3cd16e0dc024 None None] Enqueued Resource ID: 7fb39f35-d39f-44d9-bd39-14f15d9e441c with Priority: HIGHEST for action port [ 747.782781] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb39f35-d39f-44d9-bd39-14f15d9e441c with Priority: HIGHEST for action port [ 747.783111] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fb39f35-d39f-44d9-bd39-14f15d9e441c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.783280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fb39f35-d39f-44d9-bd39-14f15d9e441c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.783353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fb39f35-d39f-44d9-bd39-14f15d9e441c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.784890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fb39f35-d39f-44d9-bd39-14f15d9e441c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.784890] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fb39f35-d39f-44d9-bd39-14f15d9e441c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.918465] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.918687] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.918825] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.919204] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.919366] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.919528] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port afa035eb-e40e-4188-97ff-f12409a5951e not found, creating... [ 747.919792] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.919945] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.920078] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.920325] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.920581] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.920750] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.920895] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.921011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.921465] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.921645] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.921785] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: afa035eb-e40e-4188-97ff-f12409a5951e is going to be created. [ 747.946363] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.946571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.946689] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.946985] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.948132] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.948451] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.283889] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.284452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.284452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.284569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.284669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.284890] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.285014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.285081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.285243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.285347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.285480] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be updated. [ 748.287401] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fb39f35-d39f-44d9-bd39-14f15d9e441c [ 748.287710] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.287710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.289149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.289149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.289149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.289149] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fb39f35-d39f-44d9-bd39-14f15d9e441c already deleted. [ 748.289149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fb39f35-d39f-44d9-bd39-14f15d9e441c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.330060] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.330195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.330250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.330453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.330605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.347717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 748.352917] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 748.353173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.429969] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-264 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.430181] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.430329] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.430572] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.431091] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.431091] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.431425] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.431676] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.431853] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.432092] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.432241] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.432365] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.432567] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.432701] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.432906] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.432997] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.457386] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.457589] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 748.457750] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.457995] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.458330] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-74b5e11e-382c-499a-b3f7-39b41eec6f11 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.458502] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.458615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.458923] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.459132] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b5e11e-382c-499a-b3f7-39b41eec6f11',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.655651] env[66123]: INFO networking_nsxv3.common.synchronization [req-b357c6a4-42d1-4efc-a8cf-71c9c7d73894 req-1df4a79f-009d-4317-9848-72d6b85790e8 service nova] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 748.655854] env[66123]: INFO networking_nsxv3.common.synchronization [req-b357c6a4-42d1-4efc-a8cf-71c9c7d73894 req-1df4a79f-009d-4317-9848-72d6b85790e8 service nova] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 748.656018] env[66123]: INFO networking_nsxv3.common.synchronization [req-b357c6a4-42d1-4efc-a8cf-71c9c7d73894 req-1df4a79f-009d-4317-9848-72d6b85790e8 service nova] Enqueued Resource ID: afa035eb-e40e-4188-97ff-f12409a5951e with Priority: HIGHEST for action port [ 748.656621] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 748.657018] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 748.657018] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afa035eb-e40e-4188-97ff-f12409a5951e with Priority: HIGHEST for action port [ 748.657366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.657477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.657556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.657857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.657982] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.659509] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.659740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.659824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.660025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.660208] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.660308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.660396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.660608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.660704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.660797] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.666285] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-afa035eb-e40e-4188-97ff-f12409a5951e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.666285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.666285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.666285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.666285] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afa035eb-e40e-4188-97ff-f12409a5951e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.961642] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.961961] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.962091] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.962444] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.962605] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.962752] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 74b5e11e-382c-499a-b3f7-39b41eec6f11 not found, creating... [ 748.963037] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.963188] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.963355] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.963569] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.963696] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.964012] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.964187] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.964364] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.964596] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.964724] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.964854] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 74b5e11e-382c-499a-b3f7-39b41eec6f11 is going to be created. [ 748.986206] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.986423] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.986543] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.986823] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.987057] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.987724] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.160798] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.160967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.165460] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.167923] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afa035eb-e40e-4188-97ff-f12409a5951e with status ACTIVE [ 749.168285] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.168481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.168580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.168898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.169200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.169499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.169684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.169808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.170083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.170236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.170536] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.170679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.170788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.171012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.171738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.171738] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afa035eb-e40e-4188-97ff-f12409a5951e is going to be updated. [ 749.194380] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.194558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.194632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.194862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.195126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.195299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afa035eb-e40e-4188-97ff-f12409a5951e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.267109] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 749.267158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.519815] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 699b9736-049e-445f-86a2-8de9c9beb0cf in Status: SUCCESS [ 749.519815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.519815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.520079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.520079] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.520285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.520409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.520588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.520671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.520759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.520852] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.669132] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.726140] env[66123]: INFO networking_nsxv3.common.synchronization [req-2f0b0736-9a85-4385-829b-bbe268804923 req-1233fcd2-df17-4b37-8d94-208130ddaebe service nova] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_rules [ 749.726334] env[66123]: INFO networking_nsxv3.common.synchronization [req-2f0b0736-9a85-4385-829b-bbe268804923 req-1233fcd2-df17-4b37-8d94-208130ddaebe service nova] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 749.726710] env[66123]: INFO networking_nsxv3.common.synchronization [req-2f0b0736-9a85-4385-829b-bbe268804923 req-1233fcd2-df17-4b37-8d94-208130ddaebe service nova] Enqueued Resource ID: 74b5e11e-382c-499a-b3f7-39b41eec6f11 with Priority: HIGHEST for action port [ 749.727054] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_rules [ 749.727271] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 749.727394] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74b5e11e-382c-499a-b3f7-39b41eec6f11 with Priority: HIGHEST for action port [ 749.727670] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.727766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.727833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.728062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.728112] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.728912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.729051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.729196] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-74b5e11e-382c-499a-b3f7-39b41eec6f11 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.729453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.729453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.730348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.730433] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b5e11e-382c-499a-b3f7-39b41eec6f11',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.023767] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.023931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.024070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.024308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.024491] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.024597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.024663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.024821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.024938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.025029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.025203] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.025312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.025444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.025699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.025880] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.025979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.026077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.026258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.026344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.026446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.026608] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.171233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.171401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.171694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.171694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.171841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.171876] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be created. [ 750.180762] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1ef89124-6b29-4f8c-acde-efb5007b7fa6 None None] Enqueued Resource ID: 5f8796db-189f-420f-8be7-ccc18a58c4ed with Priority: HIGHEST for action port [ 750.181046] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f8796db-189f-420f-8be7-ccc18a58c4ed with Priority: HIGHEST for action port [ 750.181678] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f8796db-189f-420f-8be7-ccc18a58c4ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.181867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f8796db-189f-420f-8be7-ccc18a58c4ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.181906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f8796db-189f-420f-8be7-ccc18a58c4ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.183367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f8796db-189f-420f-8be7-ccc18a58c4ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.183512] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f8796db-189f-420f-8be7-ccc18a58c4ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.195421] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.195700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.195700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.195831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.195997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.208879] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: UNINITIALIZED for 2s [ 750.233969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.234147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.234383] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74b5e11e-382c-499a-b3f7-39b41eec6f11 with status ACTIVE [ 750.234660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.234765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.234871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.235167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.235276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.235462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.235565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.235632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.235791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.235870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.236063] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.236157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.236219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.236360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.236554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.236554] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74b5e11e-382c-499a-b3f7-39b41eec6f11 is going to be updated. [ 750.284805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.284805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.284805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.285195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.285195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.285257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74b5e11e-382c-499a-b3f7-39b41eec6f11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.359123] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 750.359486] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 deletion is rescheduled due to dependency. [ 750.359486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.359625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.360749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.360749] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.360749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.360749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.360749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.360749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.360749] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.533404] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 699b9736-049e-445f-86a2-8de9c9beb0cf: rpc.has_security_group_logging(os_id): False [ 750.553199] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.553199] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.553199] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.553199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.553810] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.554414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.554643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.554983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.555211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.555419] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 699b9736-049e-445f-86a2-8de9c9beb0cf is going to be created. [ 750.616517] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.616517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.616517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.616517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.616517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.629910] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 699b9736-049e-445f-86a2-8de9c9beb0cf in Status: IN_PROGRESS for 2s [ 750.686143] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f8796db-189f-420f-8be7-ccc18a58c4ed [ 750.686418] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.686860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.686860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.687073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.687729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.687729] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f8796db-189f-420f-8be7-ccc18a58c4ed already deleted. [ 750.687729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f8796db-189f-420f-8be7-ccc18a58c4ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.862730] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.366678] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.868751] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.869095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.869095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.869742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.869742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.869742] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be updated. [ 751.900451] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d307147c-80a7-4556-af9f-49e2d3c34921 tempest-ServersTestFqdnHostnames-1930379483 tempest-ServersTestFqdnHostnames-1930379483-project-member] Enqueued Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_rules [ 751.900451] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_rules [ 751.900451] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.900451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.900451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.900990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.901261] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.924010] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.924169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.924280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.924487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.924640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.937570] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 752.008702] env[66123]: INFO networking_nsxv3.common.synchronization [None req-13d83961-7bcf-4792-af58-cfee1779bd7e tempest-ServersTestFqdnHostnames-1930379483 tempest-ServersTestFqdnHostnames-1930379483-project-member] Enqueued Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_rules [ 752.010161] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_rules [ 752.010161] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.010161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.223916] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: SUCCESS [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.223916] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.223916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.223916] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.426125] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.426125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.426125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.426125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.426125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.426125] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a already deleted. [ 752.426479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.426479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.426592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.426674] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.642989] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 699b9736-049e-445f-86a2-8de9c9beb0cf in Status: SUCCESS [ 752.643403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.727213] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.844934] env[66123]: INFO networking_nsxv3.common.synchronization [None req-c62e6410-d448-40fc-a432-dd2d9d5997b5 tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 752.846435] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 752.846895] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.847086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.848213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.848213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.848213] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.948972] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.949332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.949370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.949619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.949762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.949844] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a already deleted. [ 752.949952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.958362] env[66123]: INFO networking_nsxv3.common.synchronization [None req-10210358-8cd8-4953-82d6-8f47d5b40e34 tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 752.958362] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 752.958684] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.958684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.987773] env[66123]: INFO networking_nsxv3.common.synchronization [None req-08218fd2-1159-4de5-ad1c-c54514712cd4 None None] Enqueued Resource ID: faab5c70-da99-4ebd-a62b-dd0c563a1407 with Priority: HIGHEST for action port [ 752.988040] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faab5c70-da99-4ebd-a62b-dd0c563a1407 with Priority: HIGHEST for action port [ 752.989047] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-faab5c70-da99-4ebd-a62b-dd0c563a1407 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.989047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faab5c70-da99-4ebd-a62b-dd0c563a1407" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.989047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faab5c70-da99-4ebd-a62b-dd0c563a1407" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.989736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faab5c70-da99-4ebd-a62b-dd0c563a1407" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.989736] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faab5c70-da99-4ebd-a62b-dd0c563a1407',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.232398] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d200e885-c7ad-4101-b6e0-e3026ae4d35f: rpc.has_security_group_logging(os_id): False [ 753.256152] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.256152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.256275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.256421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.256551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.257723] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.257723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.257723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.257909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.257909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.257990] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be created. [ 753.349146] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.349146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.349146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.349146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.349146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.365614] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: IN_PROGRESS for 2s [ 753.371924] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.372130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.372199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.372415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.372637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.372637] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 already deleted. [ 753.372799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.372911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.373086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.373169] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.495500] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faab5c70-da99-4ebd-a62b-dd0c563a1407 [ 753.495500] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.495500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.495500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.495500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.495500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.495500] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faab5c70-da99-4ebd-a62b-dd0c563a1407 already deleted. [ 753.495500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faab5c70-da99-4ebd-a62b-dd0c563a1407" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.896523] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.896633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.896813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.897106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.897981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.897981] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 already deleted. [ 753.897981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.950822] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 753.951072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.951117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.951363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.951556] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.951701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.951758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.951927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.951975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.952090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.952137] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.459415] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.459415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.459415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.459415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.459415] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.459905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.459905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.459905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.459905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.459905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.460099] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.460158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.460302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.460366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.461033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.461033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.461033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.461033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.461033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.461033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.461033] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.965397] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69e73b71-1b94-4c07-a51a-893782ee1e09: rpc.has_security_group_logging(os_id): False [ 754.987440] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.987866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.988118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.988420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.988714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.989097] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.990082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.990082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.990082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.990082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.990082] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.990633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.990911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.991300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.992030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.992030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.992030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.992030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.992404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.992572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.992871] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be updated. [ 755.074223] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.074384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.074997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.074997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.074997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.091611] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 755.319787] env[66123]: INFO networking_nsxv3.common.synchronization [req-0eef00f9-af7b-4466-8512-b70e4e8a37bd req-4b5791bc-5711-4689-a890-c601ed61f49e tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_members [ 755.320377] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGHEST for action security_group_members [ 755.320377] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.320517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.322262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.322262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.322262] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.322262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.322262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.322262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.322262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.322262] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.378778] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: SUCCESS [ 755.379063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.824585] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.824748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.824834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.825166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.825311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.825544] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.825642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.825892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.825892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.828333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.828333] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c is going to be updated. [ 755.865585] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.865808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.865881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.866143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.866309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.877349] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c in Status: IN_PROGRESS for 2s [ 757.109431] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 757.109674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.880536] env[66123]: INFO networking_nsxv3.common.synchronization [req-ae9ff6db-ba0b-4907-9fb2-e89cfe83252a req-61b5a3bb-9a44-4abd-afe3-b69f68cdcfad tempest-InstanceActionsTestJSON-30952341 tempest-InstanceActionsTestJSON-30952341-project-member] Enqueued Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_members [ 757.881362] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b with Priority: HIGHEST for action security_group_members [ 757.882167] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a1c9505-3726-4617-ab67-cc7b3b1e107b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.882299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.882378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.882643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.882801] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.882904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.882968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.883179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.883308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.883769] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a1c9505-3726-4617-ab67-cc7b3b1e107b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.893725] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c in Status: SUCCESS [ 757.893725] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c deletion is rescheduled due to dependency. [ 757.893725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.151487] env[66123]: INFO networking_nsxv3.common.synchronization [req-bb44b013-057f-4497-87ca-66103ae79bd6 req-480c8d68-85cf-4be8-98b0-bb3601b32a47 tempest-ServersNegativeTestJSON-927005488 tempest-ServersNegativeTestJSON-927005488-project-member] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 758.152636] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 758.152636] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.152636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.152636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.152852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.152937] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.152998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.153075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.153227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.153343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.153450] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.387016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.387189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.387280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.387562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.387662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.387953] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.388074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.388074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.388341] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.388341] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.388450] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b is going to be updated. [ 758.423673] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.424298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.424298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.424298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.424298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.435356] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b in Status: IN_PROGRESS for 2s [ 758.653146] env[66123]: INFO networking_nsxv3.common.synchronization [req-641f6f74-feeb-415a-8a13-a67b43df2b53 req-505de916-d8a5-49a0-a94a-d4a553dc9f7f tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 758.653815] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 758.656303] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.656494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.657232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.657570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.657814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.658123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.659049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.659310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.659445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.659576] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.661142] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.031111] env[66123]: INFO networking_nsxv3.common.synchronization [req-2b7caa4a-b079-4798-9efa-d05131d6c518 req-5c42d493-ef54-43e9-8305-747a2234e639 tempest-ServerAddressesTestJSON-610460707 tempest-ServerAddressesTestJSON-610460707-project-member] Enqueued Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_members [ 759.031111] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGHEST for action security_group_members [ 759.031399] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.031520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.031592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.031778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.031933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.033038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.033038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.033038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.033038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.033038] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.163892] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.164218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.164218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.165227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.165227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.165227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.165227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.165227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.165227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.165227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.165227] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 already deleted. [ 759.165227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.165581] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.197348] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.197348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.197348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.197348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.197600] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.197600] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.197736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.197957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.198136] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.198391] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.198514] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.200884] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.200884] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.200884] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.200884] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.200884] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.222866] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.223067] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.223247] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.223456] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.223778] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-42c6ac54-d293-4ab4-806e-a431e014478d taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.223951] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.224078] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.224494] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.224633] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42c6ac54-d293-4ab4-806e-a431e014478d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.535180] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.535379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.535461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.535680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.535762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.535968] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.536129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.538089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.538089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.538089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.538089] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 is going to be updated. [ 759.570389] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.570389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.570389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.570389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.570389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.582200] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 in Status: IN_PROGRESS for 2s [ 759.668045] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.668272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.668272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.668573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.668687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.668840] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be updated. [ 759.704017] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.704765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.704765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.704918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.704965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.716953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 759.727517] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.727819] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.727898] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.728210] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.728563] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.728563] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 42c6ac54-d293-4ab4-806e-a431e014478d not found, creating... [ 759.728778] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.728922] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.729424] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.729424] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.729424] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.729708] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.729910] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.730069] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.730254] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.730383] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.730567] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 42c6ac54-d293-4ab4-806e-a431e014478d is going to be created. [ 759.776208] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.776474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.776615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.776954] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.777282] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.777588] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.878566] env[66123]: INFO networking_nsxv3.common.synchronization [req-d666d913-aecc-430a-af11-4db5ddc41e5a req-54cabf7e-c31f-4c3f-8fb7-ff69e7617ea0 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 759.878790] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 759.879201] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.879349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.879451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.879728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.879969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.880609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.880609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.880609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.880609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.880810] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.382865] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.384134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.384134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.385235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.385377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.385624] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.385730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.385801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.385998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.386104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.386202] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 760.419231] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.419469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.419548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.419778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.419928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.434772] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 760.446229] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b in Status: SUCCESS [ 760.446401] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a1c9505-3726-4617-ab67-cc7b3b1e107b deletion is rescheduled due to dependency. [ 760.446519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a1c9505-3726-4617-ab67-cc7b3b1e107b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.518598] env[66123]: INFO networking_nsxv3.common.synchronization [req-641f6f74-feeb-415a-8a13-a67b43df2b53 req-751d9da3-42ec-4d16-b5ce-9d5d98fcc8ad service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 760.518910] env[66123]: INFO networking_nsxv3.common.synchronization [req-641f6f74-feeb-415a-8a13-a67b43df2b53 req-751d9da3-42ec-4d16-b5ce-9d5d98fcc8ad service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 760.519909] env[66123]: INFO networking_nsxv3.common.synchronization [req-641f6f74-feeb-415a-8a13-a67b43df2b53 req-751d9da3-42ec-4d16-b5ce-9d5d98fcc8ad service nova] Enqueued Resource ID: 42c6ac54-d293-4ab4-806e-a431e014478d with Priority: HIGHEST for action port [ 760.521254] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 760.521254] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 760.521254] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42c6ac54-d293-4ab4-806e-a431e014478d with Priority: HIGHEST for action port [ 760.521254] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.521555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.523328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.523328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.523328] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.529165] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.529165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.529165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.529165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.529165] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.529165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.529165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.529415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.529415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.530271] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.535180] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-42c6ac54-d293-4ab4-806e-a431e014478d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.535180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.535180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.535316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.535399] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42c6ac54-d293-4ab4-806e-a431e014478d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.037416] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.038873] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.039083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.039856] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42c6ac54-d293-4ab4-806e-a431e014478d with status ACTIVE [ 761.039856] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.039992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.040104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.040390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.041134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.041134] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.041134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.041134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.041134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.041424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.041424] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.041553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.041553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.041692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.041766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.041858] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42c6ac54-d293-4ab4-806e-a431e014478d is going to be updated. [ 761.065329] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.065416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.065416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.065633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.065820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.065988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42c6ac54-d293-4ab4-806e-a431e014478d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.350815] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-4c470ce0-76cd-4dba-b8b9-25e2ced0f86a tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 761.352298] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 761.352767] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.352964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.353082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.353939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.353939] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.353939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.354124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.354288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.354476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.354571] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.540060] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.592815] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 in Status: SUCCESS [ 761.592815] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 deletion is rescheduled due to dependency. [ 761.593061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.733676] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 761.733994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.790595] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.790779] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.790872] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.793605] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.793918] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.794092] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.794194] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.794436] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.794574] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.794774] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.794973] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.795094] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.795195] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.795299] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.795448] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.795589] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.817505] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.817715] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.817886] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.818146] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.818626] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.818924] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.819116] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.819530] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.821599] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0ba3ead-e3f6-4bf3-975a-2f41243207c7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.858854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.858854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.858854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.858854] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 already deleted. [ 761.859334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.043148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.046023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.046023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.046023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.046023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.046023] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be created. [ 762.078701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.081018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.081018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.081018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.081018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.095195] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: UNINITIALIZED for 2s [ 762.254485] env[66123]: INFO networking_nsxv3.common.synchronization [req-71a74cf3-1659-4a8b-8ebb-75ed0312c287 req-f7d974d3-7e2e-462b-a5f4-bc4f55bbaf10 tempest-ServerDiagnosticsNegativeTest-2132658274 tempest-ServerDiagnosticsNegativeTest-2132658274-project-member] Enqueued Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_members [ 762.254749] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGHEST for action security_group_members [ 762.255067] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.255190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.255256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.255456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.255611] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.255710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.255772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.255917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.256013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.256134] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.325112] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.325339] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.325461] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.325765] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.325913] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.326090] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port d0ba3ead-e3f6-4bf3-975a-2f41243207c7 not found, creating... [ 762.326354] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.326757] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.326757] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.326861] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.326985] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.327296] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.327450] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.327561] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.327763] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.327893] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.328036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: d0ba3ead-e3f6-4bf3-975a-2f41243207c7 is going to be created. [ 762.350646] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.350876] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.350999] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.351358] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.351618] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.351937] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.446841] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 762.447070] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 762.447178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.512463] env[66123]: INFO networking_nsxv3.common.synchronization [req-85b4723f-16ed-436a-b034-ed13a6432c48 req-e6514ff0-b1ba-4723-9254-a8df7f64c140 tempest-ServerTagsTestJSON-1794780608 tempest-ServerTagsTestJSON-1794780608-project-member] Enqueued Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_members [ 762.513041] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGHEST for action security_group_members [ 762.513543] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.513543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.513729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.513837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.514241] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.514241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.514241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.514452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.514452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.514542] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.758313] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.758666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.758666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.758799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.758849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.760047] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.760047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.760047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.760047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.760047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.760047] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 699b9736-049e-445f-86a2-8de9c9beb0cf is going to be updated. [ 762.790025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.790237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.790557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.790557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.790719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.801463] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 699b9736-049e-445f-86a2-8de9c9beb0cf in Status: IN_PROGRESS for 2s [ 763.017035] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.017327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.017418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.017641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.017738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.017930] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.018056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.018098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.018248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.018320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.018500] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c is going to be updated. [ 763.049782] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.049949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.049998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.050228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.050366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.062035] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c in Status: IN_PROGRESS for 2s [ 763.078023] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-10bd0108-8ac8-4750-84da-b82d5b71e148 service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 763.078023] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-10bd0108-8ac8-4750-84da-b82d5b71e148 service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 763.078023] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-10bd0108-8ac8-4750-84da-b82d5b71e148 service nova] Enqueued Resource ID: d0ba3ead-e3f6-4bf3-975a-2f41243207c7 with Priority: HIGHEST for action port [ 763.078023] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 763.078023] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 763.078023] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ba3ead-e3f6-4bf3-975a-2f41243207c7 with Priority: HIGHEST for action port [ 763.078763] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.079022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.079173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.079493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.079670] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.081195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.081195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.081195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.081195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.081195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.081705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.081967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.082209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.082375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.082617] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.085102] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.085102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.085102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.085102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.085102] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0ba3ead-e3f6-4bf3-975a-2f41243207c7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.361036] env[66123]: INFO networking_nsxv3.common.synchronization [req-1531b45f-6043-4280-8b7c-7e3f4bf7af3e req-b3b0cbbc-c4ec-49ca-96f3-d7b4b4258d59 tempest-ServerMetadataNegativeTestJSON-543750819 tempest-ServerMetadataNegativeTestJSON-543750819-project-member] Enqueued Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_members [ 763.361036] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGHEST for action security_group_members [ 763.361036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.361036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.361036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.361036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.361036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.361036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.361036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.362024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.362925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.363946] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.586156] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.586285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.586473] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.587377] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0ba3ead-e3f6-4bf3-975a-2f41243207c7 with status ACTIVE [ 763.587541] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.587655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.587720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.587929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.588031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.588193] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.588290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.588351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.588499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.588586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.588819] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.588920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.588980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.589237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.589316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.589399] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0ba3ead-e3f6-4bf3-975a-2f41243207c7 is going to be updated. [ 763.612125] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.612279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.612349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.612566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.612703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.612894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0ba3ead-e3f6-4bf3-975a-2f41243207c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.866027] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.866027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.866027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.866608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.866608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.866608] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.866801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.866801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.867030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.867198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.867263] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 is going to be updated. [ 763.910970] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.910970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.910970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.911475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.911475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.928122] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 in Status: IN_PROGRESS for 2s [ 764.093077] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.104743] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 764.105351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.105784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.106041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.106247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.106370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.106438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.106608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.106690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.106775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.106878] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.197274] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-80692b0e-480e-4f28-873f-7eb46e7845e0 tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 764.197916] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 764.198460] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.198460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.595540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.598058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.598058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.598058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.598058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.598058] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be created. [ 764.610162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.610162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.610162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.610162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.610446] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.610446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.610570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.610686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.610778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.610902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.611037] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.611127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.611189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.611366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611527] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.611650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.611715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.611860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.612040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.612133] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.613854] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.614097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.614097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.614308] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.614579] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.614741] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.614918] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.616110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.616266] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.616472] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.616609] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.616722] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.616820] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.616926] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.617049] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.617197] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.624660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.624889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.624889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.625120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.625243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.636278] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: UNINITIALIZED for 2s [ 764.637511] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.637696] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.637859] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.639178] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.639545] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-35e26448-82a3-4b09-9e87-f0f328cf31a8 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.639731] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.639963] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.640212] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.640368] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e26448-82a3-4b09-9e87-f0f328cf31a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.817105] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 699b9736-049e-445f-86a2-8de9c9beb0cf in Status: SUCCESS [ 764.817255] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 699b9736-049e-445f-86a2-8de9c9beb0cf deletion is rescheduled due to dependency. [ 764.817376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.073838] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c in Status: SUCCESS [ 765.074219] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c deletion is rescheduled due to dependency. [ 765.074308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.119973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 765.138848] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.139050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.139050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.139282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.139375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.139567] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.139663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.139726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.139938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.139938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.140154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.140249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.140311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.140451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.140625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.140849] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.140911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.140972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.141124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.141203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.141288] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be created. [ 765.143107] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.143282] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.143457] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.143681] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.143811] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.143945] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 35e26448-82a3-4b09-9e87-f0f328cf31a8 not found, creating... [ 765.144197] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.144345] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.144468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.144665] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.144788] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.145272] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.145488] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.145607] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.145857] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.145989] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.146138] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 35e26448-82a3-4b09-9e87-f0f328cf31a8 is going to be created. [ 765.167389] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.167647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.167781] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.168099] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.168336] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.168556] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.218975] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.219576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.219576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.219576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.219687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.262715] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 765.589558] env[66123]: INFO networking_nsxv3.common.synchronization [req-d1cbee80-2dd6-4332-afad-5fe702a39b79 req-0df74833-1361-4200-aa04-0bb66548f25f tempest-ServersAdminNegativeTestJSON-1257558661 tempest-ServersAdminNegativeTestJSON-1257558661-project-member] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 765.590051] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 765.591008] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.591008] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.591008] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.591008] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.591189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.591189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.591285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.591437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.591528] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.591625] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.917248] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-410d293f-eca2-4a56-9104-0d21a20c86aa service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 765.917248] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-410d293f-eca2-4a56-9104-0d21a20c86aa service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 765.917248] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fdffc9f-b8bf-4b74-b113-33ae340e1994 req-410d293f-eca2-4a56-9104-0d21a20c86aa service nova] Enqueued Resource ID: 35e26448-82a3-4b09-9e87-f0f328cf31a8 with Priority: HIGHEST for action port [ 765.917248] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 765.917248] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 765.917248] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e26448-82a3-4b09-9e87-f0f328cf31a8 with Priority: HIGHEST for action port [ 765.917248] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.917248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.918269] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.918530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.918871] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-35e26448-82a3-4b09-9e87-f0f328cf31a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.921052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.921052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.921052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.921052] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e26448-82a3-4b09-9e87-f0f328cf31a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.939261] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 in Status: SUCCESS [ 765.940022] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 deletion is rescheduled due to dependency. [ 765.940022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.942537] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e298fcb7-9c0c-4905-86b6-9c902564dfac None None] Enqueued Resource ID: 9b3c582a-9a3b-4796-9bb9-00e6968fac17 with Priority: HIGHEST for action port [ 765.945158] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b3c582a-9a3b-4796-9bb9-00e6968fac17 with Priority: HIGHEST for action port [ 765.945616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b3c582a-9a3b-4796-9bb9-00e6968fac17 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.945762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b3c582a-9a3b-4796-9bb9-00e6968fac17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.945831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b3c582a-9a3b-4796-9bb9-00e6968fac17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.946115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b3c582a-9a3b-4796-9bb9-00e6968fac17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.946803] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b3c582a-9a3b-4796-9bb9-00e6968fac17',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.095418] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.423731] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35e26448-82a3-4b09-9e87-f0f328cf31a8 with status ACTIVE [ 766.423799] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.424515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.424515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.424515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.424515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.424515] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.424779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.424779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.424779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.424869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.425026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.425121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.425180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.425321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.425395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.425476] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35e26448-82a3-4b09-9e87-f0f328cf31a8 is going to be updated. [ 766.448100] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.448277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.448396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.448578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.448829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.449013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35e26448-82a3-4b09-9e87-f0f328cf31a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.449245] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b3c582a-9a3b-4796-9bb9-00e6968fac17 [ 766.449415] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.449518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.449581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.449790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.449896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.449984] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b3c582a-9a3b-4796-9bb9-00e6968fac17 already deleted. [ 766.450078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b3c582a-9a3b-4796-9bb9-00e6968fac17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.597759] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.649240] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 766.650022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.652154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.652154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.652154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.652154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.652154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.652154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.652154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.652154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.652154] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.652965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.653153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.653553] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.653690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.653774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.656140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.657487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.657660] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.087381] env[66123]: INFO networking_nsxv3.common.synchronization [req-9fff49f0-bb79-4210-a59f-354d6c7767dd req-bc8cbf75-2cc8-4ea2-9e94-cf0c49b50596 tempest-ServersTestFqdnHostnames-1930379483 tempest-ServersTestFqdnHostnames-1930379483-project-member] Enqueued Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_members [ 767.088379] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_members [ 767.089852] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.090697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.091760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.095000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.095000] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.095000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.095000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.095000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.095000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.095000] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.104416] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.104416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.104416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.104416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.104416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.104416] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd is going to be updated. [ 767.140080] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.140589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.141069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.141198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.142155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.156091] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: IN_PROGRESS for 2s [ 767.162336] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.163333] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.163952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.277867] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 767.278224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.559484] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.559630] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-638" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.560461] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-638" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.560461] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-638" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.560461] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.560461] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.560653] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.560831] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.561238] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.561238] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.561323] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.561402] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.561591] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.561751] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.561931] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.562433] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.581717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.582142] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.582142] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.582261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-638" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.583824] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-2ae140a7-f3fa-4751-b785-568db2c10ad2 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.584033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.584161] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.584568] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.584647] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ae140a7-f3fa-4751-b785-568db2c10ad2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.596023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.596629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.596629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.596629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.596629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.596822] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.596822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.596920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.597309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.597309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.597309] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a already deleted. [ 767.597309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.665833] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.001565] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d870c40f-beb8-4c0a-adcf-1be020011b74 None None] Enqueued Resource ID: 7f3fcc73-fd1e-4922-ba87-b362c11b9014 with Priority: HIGHEST for action port [ 768.002259] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3fcc73-fd1e-4922-ba87-b362c11b9014 with Priority: HIGHEST for action port [ 768.002414] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f3fcc73-fd1e-4922-ba87-b362c11b9014 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.002545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f3fcc73-fd1e-4922-ba87-b362c11b9014" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.002614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f3fcc73-fd1e-4922-ba87-b362c11b9014" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.002860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f3fcc73-fd1e-4922-ba87-b362c11b9014" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.002944] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f3fcc73-fd1e-4922-ba87-b362c11b9014',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.087047] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.087480] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.087480] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.087713] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.087860] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.088016] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 2ae140a7-f3fa-4751-b785-568db2c10ad2 not found, creating... [ 768.088637] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.088841] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.089009] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.089204] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.089337] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.089645] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.090076] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.090260] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.090502] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.090739] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.091039] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 2ae140a7-f3fa-4751-b785-568db2c10ad2 is going to be created. [ 768.115290] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.115749] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.115946] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.116330] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.116535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.117941] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.169211] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.169359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.169419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.169674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.169804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.169949] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 768.202536] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.202720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.202801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.203065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.203273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.213773] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 768.506217] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f3fcc73-fd1e-4922-ba87-b362c11b9014 [ 768.506418] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.506547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.506618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.506881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.506981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.507096] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f3fcc73-fd1e-4922-ba87-b362c11b9014 already deleted. [ 768.507184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f3fcc73-fd1e-4922-ba87-b362c11b9014" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.987495] env[66123]: INFO networking_nsxv3.common.synchronization [req-9fff49f0-bb79-4210-a59f-354d6c7767dd req-95ef0e73-fb69-4027-8c3a-b1b2921e425f service nova] Enqueued Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_rules [ 768.987704] env[66123]: INFO networking_nsxv3.common.synchronization [req-9fff49f0-bb79-4210-a59f-354d6c7767dd req-95ef0e73-fb69-4027-8c3a-b1b2921e425f service nova] Enqueued Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_members [ 768.987846] env[66123]: INFO networking_nsxv3.common.synchronization [req-9fff49f0-bb79-4210-a59f-354d6c7767dd req-95ef0e73-fb69-4027-8c3a-b1b2921e425f service nova] Enqueued Resource ID: 2ae140a7-f3fa-4751-b785-568db2c10ad2 with Priority: HIGHEST for action port [ 768.988392] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_rules [ 768.988522] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_members [ 768.988617] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae140a7-f3fa-4751-b785-568db2c10ad2 with Priority: HIGHEST for action port [ 768.988897] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.990733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.990885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.991114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.991198] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.992111] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.992615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.992710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.992890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.993310] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.995352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.995352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.995352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.995352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.995352] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.996916] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ae140a7-f3fa-4751-b785-568db2c10ad2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.996916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.997040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.998112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.998112] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ae140a7-f3fa-4751-b785-568db2c10ad2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.167414] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: SUCCESS [ 769.167689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.181196] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 769.181391] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:1 started [ 769.498247] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.502022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ae140a7-f3fa-4751-b785-568db2c10ad2 with status ACTIVE [ 769.502022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.502022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.502022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.502022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.502022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ae140a7-f3fa-4751-b785-568db2c10ad2 is going to be updated. [ 769.506503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.506503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.528943] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.528943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.528943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.528943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.528943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.528943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ae140a7-f3fa-4751-b785-568db2c10ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.000071] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.189126] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e149ff3-77df-4fd9-8ad7-d55b4f321696 req-eba852cf-94a7-42a6-af83-80d266d7d938 tempest-ServersTestManualDisk-969714279 tempest-ServersTestManualDisk-969714279-project-member] Enqueued Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_members [ 770.189450] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGHEST for action security_group_members [ 770.192145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.192145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.192145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.192145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.192145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.192145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.192145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.192145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.192145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.192145] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.226813] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 4s [ 770.494112] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ffbbeb50-e87a-4d01-bcb4-3b717a221515 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_rules [ 770.494666] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_rules [ 770.495039] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.496926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.497114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.497870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.497870] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.505259] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.505259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.505259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.505259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.505259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.505259] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a is going to be created. [ 770.534765] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.534957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.534957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.537306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.537306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.551355] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a in Status: UNINITIALIZED for 2s [ 770.606198] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1135d81d-437e-45e2-a76b-cc992c2dbc45 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_rules [ 770.606745] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_rules [ 770.607094] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.607223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.693121] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.693343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.693457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.693749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.693887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.694227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.694402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.694562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.694895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.695055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.695188] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 is going to be updated. [ 770.728015] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.730663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.730663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.730663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.730663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.740155] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 in Status: IN_PROGRESS for 2s [ 771.021262] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.021262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.021262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.021262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.021597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.021597] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48aac306-03a8-4928-8815-44ca0617408c already deleted. [ 771.021597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.021712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.022870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.022870] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.551985] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.552324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.552393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.552658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.552866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.552866] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48aac306-03a8-4928-8815-44ca0617408c already deleted. [ 771.553064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.240226] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 772.240522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.240771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.240912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.241334] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.242029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.242029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.242029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.242338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.242663] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.568776] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a in Status: SUCCESS [ 772.569178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.569296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.569429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.569632] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.569749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.569814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.569966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.570053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.570140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.570226] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.745576] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.753196] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 in Status: SUCCESS [ 772.753868] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 deletion is rescheduled due to dependency. [ 772.753868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.072435] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.249501] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.574979] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee0f66d6-515b-47ee-bcf1-99417ad55a0a: rpc.has_security_group_logging(os_id): False [ 773.598762] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.598930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.599012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.599266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.599378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.599653] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.599752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.599817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.600033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.600128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.600224] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a is going to be created. [ 773.669061] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.669061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.669061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.669061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.669061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.683044] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a in Status: IN_PROGRESS for 2s [ 773.752257] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.752433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.752600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.752918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.753073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.753223] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 773.803728] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.803916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.803980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.804188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.804343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.817780] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 774.287441] env[66123]: INFO networking_nsxv3.common.synchronization [req-9ac37636-593a-4611-aaa0-35f424e7d4d7 req-dcd057c5-ced9-48f2-956c-1760c7c74388 tempest-ServerMetadataTestJSON-1747236582 tempest-ServerMetadataTestJSON-1747236582-project-member] Enqueued Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_members [ 774.288018] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGHEST for action security_group_members [ 774.288493] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.288493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.288647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.288750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.288873] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.288993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.289097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.289230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.289385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.289385] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.791868] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.792187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.792187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.792934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.792934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.792934] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.792934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.792934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.793289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.793289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.793289] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d is going to be updated. [ 774.841937] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.842106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.842214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.842426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.842539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.853651] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d in Status: IN_PROGRESS for 2s [ 775.696708] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a in Status: SUCCESS [ 775.696934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.828433] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 775.828845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.829073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.829302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.829502] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.829634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.829805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.830027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.830168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.830313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.830875] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.831125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.831274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.831997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.832295] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.832478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.832590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.832786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.832913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.833172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.833328] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.336974] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c33bec6e-2ebe-4c3c-a232-8a79edacefc8: rpc.has_security_group_logging(os_id): False [ 776.363104] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.363273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.363347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.363611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.363697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.363906] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.364032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.364101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.364275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.364335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.364543] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.364637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.364709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.364853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.364925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.365339] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.365339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.365339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.365517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.365517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.365607] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be created. [ 776.430992] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.431161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.431225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.431517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.431731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.443921] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 776.866398] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d in Status: SUCCESS [ 776.866696] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d deletion is rescheduled due to dependency. [ 776.866696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.921964] env[66123]: INFO networking_nsxv3.common.synchronization [req-0785301c-1188-41db-aa99-b3fd52674069 req-bc23a1d0-5c4e-4149-a9f7-4426bf506bc1 tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 776.922642] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 776.923036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.923225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.923301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.923626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.923844] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.923985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.924071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.924288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.924473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.924601] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.349683] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.349990] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.350155] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.350937] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.350937] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.350937] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.351195] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.351234] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.351399] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.351659] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.351770] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.351871] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.351999] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.352109] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.352249] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.352374] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.385430] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.385430] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.385430] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.385430] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.385430] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-717bfecd-4ef1-49de-abec-694c86f5a0e5 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.385430] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.385430] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.385430] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.385763] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('717bfecd-4ef1-49de-abec-694c86f5a0e5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.427914] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.428102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.428177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.428400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.428506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.428704] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.428791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.428857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.428997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.429100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.429186] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 already deleted. [ 777.429335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.887599] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.887979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.887979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.888247] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.888387] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.888539] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 717bfecd-4ef1-49de-abec-694c86f5a0e5 not found, creating... [ 777.888799] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.888955] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.889082] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.889296] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.889423] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.889694] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.889839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.889948] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.890181] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.890303] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.890432] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 717bfecd-4ef1-49de-abec-694c86f5a0e5 is going to be created. [ 777.913303] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.913573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.913657] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.913903] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.914143] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.914359] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.955796] env[66123]: INFO networking_nsxv3.common.synchronization [req-e1cf6fb1-a6bf-4be4-89f5-61889985d9ca req-c6f18d83-8041-4570-a080-19fc3ba9283c tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 777.956443] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 777.956787] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.956912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.956977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.957186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.957353] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.957444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.957495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.957657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.957754] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.957830] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.459044] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 778.460238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.460238] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.460238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.460238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.460608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.460703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.460992] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.461172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.461280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.461613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.461749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.461881] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be updated. [ 778.463351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.463626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.464643] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.496578] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.496811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.496921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.497431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.497520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.508822] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 778.616632] env[66123]: INFO networking_nsxv3.common.synchronization [req-0785301c-1188-41db-aa99-b3fd52674069 req-89da6d45-da02-4825-a3aa-3f7c90054006 service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 778.616797] env[66123]: INFO networking_nsxv3.common.synchronization [req-0785301c-1188-41db-aa99-b3fd52674069 req-89da6d45-da02-4825-a3aa-3f7c90054006 service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 778.616927] env[66123]: INFO networking_nsxv3.common.synchronization [req-0785301c-1188-41db-aa99-b3fd52674069 req-89da6d45-da02-4825-a3aa-3f7c90054006 service nova] Enqueued Resource ID: 717bfecd-4ef1-49de-abec-694c86f5a0e5 with Priority: HIGHEST for action port [ 778.617539] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 778.617915] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 778.617915] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717bfecd-4ef1-49de-abec-694c86f5a0e5 with Priority: HIGHEST for action port [ 778.618426] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.618426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.618426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.618975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.618975] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.619575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.619690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.619974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.619974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.620629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.620770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.620850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.621049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.621154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.621233] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.622145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-717bfecd-4ef1-49de-abec-694c86f5a0e5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.622281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.622370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.622624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.622624] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('717bfecd-4ef1-49de-abec-694c86f5a0e5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.768134] env[66123]: INFO networking_nsxv3.common.synchronization [req-6f04aee9-e144-4854-a8cb-a0a53e970c89 req-b98a7342-e211-4f29-bf5c-40d0ae214c7b tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 778.768781] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 778.769122] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.770032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.770032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.770286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.771421] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.771421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.771421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.771421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.771421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.771421] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.950242] env[66123]: INFO networking_nsxv3.common.synchronization [req-8e458115-1379-45ec-856e-1020be122421 req-2b5b447f-822a-4865-aa4a-d483118f2bb7 tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 778.950242] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 778.951667] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.951797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.968389] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.968389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.124261] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.125035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.125035] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.128517] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 717bfecd-4ef1-49de-abec-694c86f5a0e5 with status ACTIVE [ 779.128680] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.128798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.128866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.129091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.129180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.129353] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.129479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.129534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.129656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.129732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.130901] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.130901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.130901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.130901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.130901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.130901] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 717bfecd-4ef1-49de-abec-694c86f5a0e5 is going to be updated. [ 779.152740] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.152857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.152927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.153156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.153298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.153587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-717bfecd-4ef1-49de-abec-694c86f5a0e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.274636] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.629397] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.780275] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.131621] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.132082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.132082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.132259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.132396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.133036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be created. [ 780.157142] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.157361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.157439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.157692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.157921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.168800] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: UNINITIALIZED for 2s [ 780.284995] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.284995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.284995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.285318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.285318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.285426] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 780.317502] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.317502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.317502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.317684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.317825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.331742] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 780.519786] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 780.519786] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 deletion is rescheduled due to dependency. [ 780.520026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.183107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 782.183107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.183107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.183107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.183577] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.183577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.183577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.184805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.184805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.184805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.184805] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.342200] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 782.342419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.342591] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.342861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.343084] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.343221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.343360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.343409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.343542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.343657] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.687401] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.849021] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.849156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.849233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.849453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.849547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.849768] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.849839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.849902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.850066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.850146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.850231] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 782.882067] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.882067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.882067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.882067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.882067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.899103] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 783.193463] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbec3ba3-84bb-4f89-a861-89e446288553: rpc.has_security_group_logging(os_id): False [ 783.214292] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.214460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.214460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.214677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.214767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.215109] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.215211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.215278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.215439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.215521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.215609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be created. [ 783.296164] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.296164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.296335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.296505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.296988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.309126] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 783.951745] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 783.951892] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 784.916123] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 784.916608] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 deletion is rescheduled due to dependency. [ 784.916884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.917270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.917728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.918169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.918409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.918552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.918978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.919225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.919479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.919725] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.338590] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 785.338851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.422832] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.423107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.423175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.423613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.424924] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.425112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.425168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.425861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.425861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.425861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.426551] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.426551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.426551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.426551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.426732] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.426732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.426732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.426922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.426975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.427139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.427139] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.641273] env[66123]: INFO networking_nsxv3.common.synchronization [req-d10e5a50-fde5-424f-9f66-2c35db19f4ed req-4aa1a7f0-c9b9-4717-98a2-8f8f5c70e8cd tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 785.641900] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 785.642480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.642480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.642480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.642694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.642725] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.642864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.642902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.643062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.643168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.643267] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.930679] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c33bec6e-2ebe-4c3c-a232-8a79edacefc8: rpc.has_security_group_logging(os_id): False [ 785.953170] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.953474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.953474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.953763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.953898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.954136] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.954239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.954299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.954465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.954687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.955114] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.955114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.955246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.955322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.955397] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.955600] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.955690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.955748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.955905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.955989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.956065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 786.036197] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.036871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.037154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.037560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.037882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.062473] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 786.148267] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.468253] env[66123]: INFO networking_nsxv3.common.synchronization [None req-3bc57cca-6924-4e8a-ba2d-1219e074f7f4 None None] Enqueued Resource ID: 5240b9c9-f58b-474e-93bd-5b784f1a4377 with Priority: HIGHEST for action port [ 786.468614] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5240b9c9-f58b-474e-93bd-5b784f1a4377 with Priority: HIGHEST for action port [ 786.469099] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5240b9c9-f58b-474e-93bd-5b784f1a4377 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.470029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5240b9c9-f58b-474e-93bd-5b784f1a4377" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.470300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5240b9c9-f58b-474e-93bd-5b784f1a4377" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.472028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5240b9c9-f58b-474e-93bd-5b784f1a4377" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.472028] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5240b9c9-f58b-474e-93bd-5b784f1a4377',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.652715] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.973459] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5240b9c9-f58b-474e-93bd-5b784f1a4377 [ 786.973973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.973973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.973973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.974909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.975068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.975186] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5240b9c9-f58b-474e-93bd-5b784f1a4377 already deleted. [ 786.975405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5240b9c9-f58b-474e-93bd-5b784f1a4377" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.155930] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.156158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.156214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.156416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.156496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.156592] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 787.190457] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.190661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.190764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.191035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.192136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.208832] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 788.075593] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 788.075988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.222067] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 789.222422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.232746] env[66123]: INFO networking_nsxv3.common.synchronization [None req-c92251d9-bf70-48dd-a2bd-a91512b44402 None None] Enqueued Resource ID: a436cb73-ce71-4e92-937b-fd2bf27dfbd0 with Priority: HIGHEST for action port [ 789.233675] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a436cb73-ce71-4e92-937b-fd2bf27dfbd0 with Priority: HIGHEST for action port [ 789.233784] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a436cb73-ce71-4e92-937b-fd2bf27dfbd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.233883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a436cb73-ce71-4e92-937b-fd2bf27dfbd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.236070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a436cb73-ce71-4e92-937b-fd2bf27dfbd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.236350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a436cb73-ce71-4e92-937b-fd2bf27dfbd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.236696] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a436cb73-ce71-4e92-937b-fd2bf27dfbd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.741285] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a436cb73-ce71-4e92-937b-fd2bf27dfbd0 [ 789.741359] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.741430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.741940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.741940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.741940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.741940] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a436cb73-ce71-4e92-937b-fd2bf27dfbd0 already deleted. [ 789.742156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a436cb73-ce71-4e92-937b-fd2bf27dfbd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.151416] env[66123]: INFO networking_nsxv3.common.synchronization [None req-93d66931-8733-4441-900d-6d333a5e7db5 None None] Enqueued Resource ID: aeeb2e12-4030-4257-ae8b-7f5c1a607568 with Priority: HIGHEST for action port [ 791.151416] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb2e12-4030-4257-ae8b-7f5c1a607568 with Priority: HIGHEST for action port [ 791.151416] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-aeeb2e12-4030-4257-ae8b-7f5c1a607568 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.151416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aeeb2e12-4030-4257-ae8b-7f5c1a607568" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.151416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aeeb2e12-4030-4257-ae8b-7f5c1a607568" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.151416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aeeb2e12-4030-4257-ae8b-7f5c1a607568" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.151416] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeeb2e12-4030-4257-ae8b-7f5c1a607568',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.656332] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aeeb2e12-4030-4257-ae8b-7f5c1a607568 [ 791.657267] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.657267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.657267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.657267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.657267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.657267] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aeeb2e12-4030-4257-ae8b-7f5c1a607568 already deleted. [ 791.657267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aeeb2e12-4030-4257-ae8b-7f5c1a607568" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.522333] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d6989cec-8f1e-4311-ab13-464ed4cec689 None None] Enqueued Resource ID: 9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe with Priority: HIGHEST for action port [ 793.522598] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe with Priority: HIGHEST for action port [ 793.523550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.523550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.523550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.523726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.524093] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.029427] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe [ 794.029528] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.029594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.030031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.030031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.030127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.030178] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe already deleted. [ 794.030551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a40a9a7-4e8e-4d1b-aa17-2fc4e3bea7fe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.138455] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.139288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.139288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.139288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.139288] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.642931] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.866224] env[66123]: INFO networking_nsxv3.common.synchronization [None req-462e0593-e711-4597-867e-259c73789535 None None] Enqueued Resource ID: 2973e234-9cf2-4cd0-8c54-f253842db6e8 with Priority: HIGHEST for action port [ 797.866921] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2973e234-9cf2-4cd0-8c54-f253842db6e8 with Priority: HIGHEST for action port [ 797.867474] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2973e234-9cf2-4cd0-8c54-f253842db6e8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.869670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2973e234-9cf2-4cd0-8c54-f253842db6e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.869670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2973e234-9cf2-4cd0-8c54-f253842db6e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.869670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2973e234-9cf2-4cd0-8c54-f253842db6e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.869670] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2973e234-9cf2-4cd0-8c54-f253842db6e8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.145640] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.256387] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.256553] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.256671] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.256934] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257213] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.257338] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.257449] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257782] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.257988] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.258127] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.258230] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.258332] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.258436] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.258533] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.258655] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.280745] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.281059] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.281266] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.281529] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.282124] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.282395] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.282589] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.282963] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.283190] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cff2bfb-bf8b-40f4-9bdb-4ed875735f03',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.371325] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2973e234-9cf2-4cd0-8c54-f253842db6e8 [ 798.371622] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.371769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.371838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.372071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.372379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.372379] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2973e234-9cf2-4cd0-8c54-f253842db6e8 already deleted. [ 798.372502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2973e234-9cf2-4cd0-8c54-f253842db6e8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.651034] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 798.651034] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 798.786344] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.786587] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.786587] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.786836] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.786978] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.787281] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.787434] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.787544] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.787763] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.787895] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.788231] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.788427] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.788506] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.788639] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.788763] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.788896] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 is going to be updated. [ 798.827879] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.828125] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.828233] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.828518] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.828708] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.828929] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.048110] env[66123]: INFO networking_nsxv3.common.synchronization [None req-21f66a12-29c3-49e4-b7d9-eb9394e1a5fc None None] Enqueued Resource ID: 02e20c61-6a06-4297-9849-d277e926aef1 with Priority: HIGHEST for action port [ 799.049379] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e20c61-6a06-4297-9849-d277e926aef1 with Priority: HIGHEST for action port [ 799.049379] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-02e20c61-6a06-4297-9849-d277e926aef1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.049379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02e20c61-6a06-4297-9849-d277e926aef1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.049379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02e20c61-6a06-4297-9849-d277e926aef1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.049379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02e20c61-6a06-4297-9849-d277e926aef1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.049599] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02e20c61-6a06-4297-9849-d277e926aef1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.526816] env[66123]: INFO networking_nsxv3.common.synchronization [req-632eeac7-d952-4e1a-baf8-d37861ad0357 req-7d2f0d5e-1d76-4784-8bd2-581736f2b0eb service nova] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 799.527096] env[66123]: INFO networking_nsxv3.common.synchronization [req-632eeac7-d952-4e1a-baf8-d37861ad0357 req-7d2f0d5e-1d76-4784-8bd2-581736f2b0eb service nova] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 799.527132] env[66123]: INFO networking_nsxv3.common.synchronization [req-632eeac7-d952-4e1a-baf8-d37861ad0357 req-7d2f0d5e-1d76-4784-8bd2-581736f2b0eb service nova] Enqueued Resource ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 with Priority: HIGHEST for action port [ 799.527994] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_rules [ 799.527994] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 799.527994] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 with Priority: HIGHEST for action port [ 799.528280] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.528408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.528494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.528670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.528741] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.530989] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.530989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.530989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.530989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.530989] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.530989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.530989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.531570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.531570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.531570] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.532218] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.532334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.532400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.532548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.532620] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cff2bfb-bf8b-40f4-9bdb-4ed875735f03',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.553854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.554051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.554144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.554350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.567147] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 799.568157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.569914] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 799.571726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02e20c61-6a06-4297-9849-d277e926aef1 [ 799.572023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.572124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.572124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.572307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.572383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.573340] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02e20c61-6a06-4297-9849-d277e926aef1 already deleted. [ 799.573340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02e20c61-6a06-4297-9849-d277e926aef1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.599177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.599326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.599398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.599604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.606682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.607226] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 799.607311] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.607398] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 799.645775] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.646083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.646083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.646214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.648111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.648295] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 799.714177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.714264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.714350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.715739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.715982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.716252] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 799.779558] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.779714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.779796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.780190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.784386] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.784492] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 799.784585] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3f94438f-58b5-4c82-8302-4f45a58dee50', '63ce70da-7be6-4476-bdbe-08aaf4677d57', 'a1b3e626-c03f-466a-b911-e8ab22cc99de', 'f8bef11c-ef0e-4ed1-b9a3-f27537962a61', 'e1957763-4da9-4aac-91d0-1bb35c3e6d74', '699b9736-049e-445f-86a2-8de9c9beb0cf', 'acae7498-6eb9-4817-9d61-924a64d54580', 'bbec3ba3-84bb-4f89-a861-89e446288553', 'a920e51b-9550-463b-b158-782df4ef60d2', '6e957e33-aa0d-4a2f-94eb-3cebae587fb7', '7213055e-f608-4dd8-a88d-e239bea6bb7b', 'beea9cef-3af0-4483-a93d-bbe9235a8fc4', '3af04420-6b85-4613-8554-92a0065c78dc', '34c25001-52de-43e0-a917-8228366264a0', 'b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2', 'e136940d-8ffe-47bc-b8b9-42f22d7b072d', 'faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d', '2336a996-6f79-4ed3-957d-c1cac2fff362', '69e73b71-1b94-4c07-a51a-893782ee1e09', 'b4d63eb4-28c8-48e7-a18d-645e4eea8c5c', '2c6dbcb4-05b5-47cd-91b4-bf12d7469a76', '46ae9dcf-d3ab-4655-9efc-c1a218c2dc56', 'bb8f4e60-4319-40b5-a8f3-20680c5bcb74', '86c8a328-51f3-46d6-a72c-f22aefa2fcf2', 'ee0f66d6-515b-47ee-bcf1-99417ad55a0a', 'ae4b87ee-cc63-4241-b970-23c1a58e9362', 'fc1efda8-467e-44a4-8d86-5f1d56a91f3c', 'c33bec6e-2ebe-4c3c-a232-8a79edacefc8', '6be2818f-6bbe-47a1-a41d-086de5f4b5d0', 'd200e885-c7ad-4101-b6e0-e3026ae4d35f', '6a1c9505-3726-4617-ab67-cc7b3b1e107b', 'cc8e203a-a322-44a7-8e22-6a43e3c9abbd', '7021f924-400e-4d63-ac79-b87e4a1fc7d7', 'f3b19fe3-562d-4163-b8e0-7d5f0c6475ed', '1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c'} {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.784681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 799.805681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.805681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.805681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.805681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.805681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.805681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 799.805681] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.805681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 799.872889] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.873059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.873059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.873266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.874040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.874342] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 799.874418] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.875144] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 799.875144] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 799.875144] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 799.875144] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGH for action security_group_rules [ 799.875144] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGH for action security_group_rules [ 799.875144] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGH for action security_group_rules [ 799.875144] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGH for action security_group_rules [ 799.875144] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGH for action security_group_rules [ 799.875144] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGH for action security_group_rules [ 799.875507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGH for action security_group_rules [ 799.875507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGH for action security_group_rules [ 799.875507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGH for action security_group_rules [ 799.875507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGH for action security_group_rules [ 799.875507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGH for action security_group_rules [ 799.875507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGH for action security_group_rules [ 799.875507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGH for action security_group_rules [ 799.875692] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGH for action security_group_rules [ 799.875692] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGH for action security_group_rules [ 799.875748] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGH for action security_group_rules [ 799.875860] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGH for action security_group_rules [ 799.875860] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGH for action security_group_rules [ 799.875942] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGH for action security_group_rules [ 799.875984] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGH for action security_group_rules [ 799.876090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.035281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.035281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.035281] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.037199] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 with status ACTIVE [ 800.037310] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.037453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.037551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.038605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.038605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.038605] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.038605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.038605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.038605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.038605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.038605] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.038931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.038931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.038931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.038931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.039065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cff2bfb-bf8b-40f4-9bdb-4ed875735f03 is going to be updated. [ 800.074981] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.074981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.074981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.074981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.075291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.075291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cff2bfb-bf8b-40f4-9bdb-4ed875735f03" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.544169] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.966508] env[66123]: INFO networking_nsxv3.common.synchronization [None req-52172bee-16df-464f-81cb-e493dba68915 None None] Enqueued Resource ID: a2ec8ce4-f71e-4e86-b251-00520e364217 with Priority: HIGHEST for action port [ 800.967748] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ec8ce4-f71e-4e86-b251-00520e364217 with Priority: HIGHEST for action port [ 800.967921] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGH for action security_group_rules [ 800.968044] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGH for action security_group_rules [ 800.968153] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acae7498-6eb9-4817-9d61-924a64d54580 with Priority: HIGH for action security_group_rules [ 800.968254] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 with Priority: HIGH for action security_group_rules [ 800.968351] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c with Priority: HIGH for action security_group_rules [ 800.968443] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGH for action security_group_rules [ 800.968536] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 with Priority: HIGH for action security_group_rules [ 800.968730] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d with Priority: HIGH for action security_group_rules [ 800.968730] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c25001-52de-43e0-a917-8228366264a0 with Priority: HIGH for action security_group_rules [ 800.968824] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d with Priority: HIGH for action security_group_rules [ 800.968891] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGH for action security_group_rules [ 800.968983] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 with Priority: HIGH for action security_group_rules [ 800.969518] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b with Priority: HIGH for action security_group_rules [ 800.969606] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 with Priority: HIGH for action security_group_rules [ 800.969712] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGH for action security_group_rules [ 800.969811] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699b9736-049e-445f-86a2-8de9c9beb0cf with Priority: HIGH for action security_group_rules [ 800.969908] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGH for action security_group_rules [ 800.970013] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 with Priority: HIGH for action security_group_rules [ 800.970108] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGH for action security_group_rules [ 800.970200] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 with Priority: HIGH for action security_group_rules [ 800.970520] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ec8ce4-f71e-4e86-b251-00520e364217 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.970649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ec8ce4-f71e-4e86-b251-00520e364217" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.970718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ec8ce4-f71e-4e86-b251-00520e364217" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.971106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ec8ce4-f71e-4e86-b251-00520e364217" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.971202] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ec8ce4-f71e-4e86-b251-00520e364217',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.972954] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.973204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.973430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.973535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.973602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.973820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.973900] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.975300] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acae7498-6eb9-4817-9d61-924a64d54580 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.975419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.975488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.975664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.975743] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acae7498-6eb9-4817-9d61-924a64d54580',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.976683] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.976793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.976861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.977037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.977114] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.977827] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.977928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.978129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.978176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.978225] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d63eb4-28c8-48e7-a18d-645e4eea8c5c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.979095] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.979206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.979275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.979441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.979490] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.982367] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2336a996-6f79-4ed3-957d-c1cac2fff362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.982483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.982560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.982724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.982803] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2336a996-6f79-4ed3-957d-c1cac2fff362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.984970] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.985114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.985195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.985364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.985439] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.986984] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34c25001-52de-43e0-a917-8228366264a0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.987117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.987187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.987379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.987425] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34c25001-52de-43e0-a917-8228366264a0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.988853] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.989121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.989121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.989205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.989275] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e136940d-8ffe-47bc-b8b9-42f22d7b072d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.989872] env[66123]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 800.990969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.992184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.992184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.992184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.992184] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.992788] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.992890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.992945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.993117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.993182] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beea9cef-3af0-4483-a93d-bbe9235a8fc4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.994575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7213055e-f608-4dd8-a88d-e239bea6bb7b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.994700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.994770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.994918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.994998] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7213055e-f608-4dd8-a88d-e239bea6bb7b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.996438] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.996566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.996729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.997272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.997272] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e957e33-aa0d-4a2f-94eb-3cebae587fb7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.998658] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.998658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.998801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.000649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.000649] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.000649] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-699b9736-049e-445f-86a2-8de9c9beb0cf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.000649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.000649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.000649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.000649] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('699b9736-049e-445f-86a2-8de9c9beb0cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.001402] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.001456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.001524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.001696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.001772] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.002740] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.002841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.002909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.003530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.003680] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1957763-4da9-4aac-91d0-1bb35c3e6d74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.004765] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.004905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.004986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.006146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.006146] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.006281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.006398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.006440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.007263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.007263] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8bef11c-ef0e-4ed1-b9a3-f27537962a61',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.007263] env[66123]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 801.015129] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2ec8ce4-f71e-4e86-b251-00520e364217 [ 801.015336] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.015458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.015532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.015710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.015857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.015922] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2ec8ce4-f71e-4e86-b251-00520e364217 already deleted. [ 801.017457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ec8ce4-f71e-4e86-b251-00520e364217" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.048591] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.048791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.049040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.049602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.051208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.051208] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 is going to be updated. [ 801.067201] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.067356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.067449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.067589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.069183] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.069315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.117337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.117402] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acae7498-6eb9-4817-9d61-924a64d54580 is going to be deleted. [ 801.118493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.118782] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.120822] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.120959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.121018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.121196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.121878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.132922] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: IN_PROGRESS for 2s [ 801.143504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.143504] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d63eb4-28c8-48e7-a18d-645e4eea8c5c is going to be deleted. [ 801.205182] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.205378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.205378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.205593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.205658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.205776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acae7498-6eb9-4817-9d61-924a64d54580" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.218909] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.219024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.219119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.219588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.219588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.219588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d63eb4-28c8-48e7-a18d-645e4eea8c5c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.422487] env[66123]: INFO networking_nsxv3.common.synchronization [None req-3f3979e7-b40e-4018-92f1-8e90444fd2a3 None None] Enqueued Resource ID: a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2 with Priority: HIGHEST for action port [ 801.423142] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2 with Priority: HIGHEST for action port [ 801.423537] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.423707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.423789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.425979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.426125] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.500476] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.500667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.500729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.500893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.537852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.537977] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be deleted. [ 801.540133] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.540283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.540477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.543135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.568263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.568263] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2 is going to be deleted. [ 801.590167] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.590167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.590167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.590167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.590167] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.590167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.590167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.593751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.593751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.593751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.593751] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.600316] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.601115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.601115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.601115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.601115] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.601115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.601349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.602420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.602420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.602420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.602420] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.604326] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.604326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.604505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.604659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.604818] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.604966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.605763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.605763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.605763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.605763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.605763] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.611024] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.611024] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.611024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.611024] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.618516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.618709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.618811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.619094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.625966] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.626426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.657236] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.657962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.658655] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.658758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.661423] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.661642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.663135] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.663135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.666781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.666781] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8bef11c-ef0e-4ed1-b9a3-f27537962a61 is going to be deleted. [ 801.667682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.667939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.668049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.668175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.668974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.669414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.697869] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.697869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.697869] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.697869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.701622] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.702982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.703706] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.704842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.705297] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.705413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.706898] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.707157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.709544] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 801.709544] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.709544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.765443] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 801.765443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.765443] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7213055e-f608-4dd8-a88d-e239bea6bb7b is going to be deleted. [ 801.765443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.765883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.808320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.808622] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1957763-4da9-4aac-91d0-1bb35c3e6d74 is going to be deleted. [ 801.809678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.809926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.860924] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.861132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.875763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.875763] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2336a996-6f79-4ed3-957d-c1cac2fff362 is going to be deleted. [ 801.875763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.875763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.929616] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2 [ 801.929824] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.929955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.930058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.930291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.931132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.931132] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2 already deleted. [ 801.931132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a969cc38-7e0a-4998-ab2a-4dbb8fad8ae2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.948045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.948045] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be deleted. [ 801.949235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.949471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.951560] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.951560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.015518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.015692] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34c25001-52de-43e0-a917-8228366264a0 is going to be deleted. [ 802.016710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.016952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.041367] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.041593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.079932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.079932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.115068] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.118255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.118407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.118479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.118706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.118877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.119013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.119200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.119369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.119460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.119572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120345] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.120345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.120345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.120345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.120345] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.120345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.120345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.120761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.120761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120761] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.122429] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.127055] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.195416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.195608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e136940d-8ffe-47bc-b8b9-42f22d7b072d is going to be deleted. [ 802.196826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.197316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.208034] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.208219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.304364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.305055] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 699b9736-049e-445f-86a2-8de9c9beb0cf is going to be deleted. [ 802.305602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.305841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.309087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.309274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.340173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.340340] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beea9cef-3af0-4483-a93d-bbe9235a8fc4 is going to be deleted. [ 802.342903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.342903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.342903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.342903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ad16b3-bb9b-4db3-88c4-f2a98ea8f4b2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.342903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.342903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.524587] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.524746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.525607] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.525822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.527411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.527411] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d is going to be deleted. [ 802.528084] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.528188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.528258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.528471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.528557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.528685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-699b9736-049e-445f-86a2-8de9c9beb0cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.529421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.529601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.604138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.604138] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e957e33-aa0d-4a2f-94eb-3cebae587fb7 is going to be deleted. [ 802.604979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.605232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1957763-4da9-4aac-91d0-1bb35c3e6d74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2336a996-6f79-4ed3-957d-c1cac2fff362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.606741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7213055e-f608-4dd8-a88d-e239bea6bb7b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.607791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34c25001-52de-43e0-a917-8228366264a0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beea9cef-3af0-4483-a93d-bbe9235a8fc4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e136940d-8ffe-47bc-b8b9-42f22d7b072d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.609340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8bef11c-ef0e-4ed1-b9a3-f27537962a61" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.617599] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3af04420-6b85-4613-8554-92a0065c78dc: rpc.has_security_group_logging(os_id): False [ 802.623870] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 802.631236] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbec3ba3-84bb-4f89-a861-89e446288553: rpc.has_security_group_logging(os_id): False [ 802.631236] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63ce70da-7be6-4476-bdbe-08aaf4677d57: rpc.has_security_group_logging(os_id): False [ 802.773791] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.773791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.773791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.774255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.777465] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.777639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.778555] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.778830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.786832] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.787053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.813953] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.814171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.834903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.835499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.835769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.835911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.837875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.837875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.837875] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be updated. [ 802.838302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.838617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.889768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.890138] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.890238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.890305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.890527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.890606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.890711] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 802.891927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.892405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.946207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.946207] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.946207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.946207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.947331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.947331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.947331] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 is going to be updated. [ 802.947668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.947860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.964707] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.965028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.973086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.973320] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.973451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.973525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.973799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.973882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.974535] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.974660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.974740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.975370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.975370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.975370] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.975370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.975370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.975726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.975726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.975726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 802.976762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.976932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.977014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.977134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faabf0bf-e4cf-4e3f-bb6e-3c5b8a3a744d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.977263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.977409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.977482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.977592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e957e33-aa0d-4a2f-94eb-3cebae587fb7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.036089] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.036089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.036447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.036521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.037050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.095905] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: IN_PROGRESS for 2s [ 803.100049] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.100049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.100049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.100346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.100346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.113985] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.115201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.115201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.115201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.115201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.139779] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 803.159626] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: IN_PROGRESS for 2s [ 803.162756] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: SUCCESS [ 803.163062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.163370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.163769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.164124] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.164262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.164363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.164637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.164773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.165055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.169215] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.200748] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 803.201854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.203047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.203047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.203047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.203047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.275301] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 803.675872] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.177819] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f94438f-58b5-4c82-8302-4f45a58dee50: rpc.has_security_group_logging(os_id): False [ 804.199378] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.199523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.199595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.199815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.222052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.222373] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.222496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.222562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.222762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.222857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.223131] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 is going to be updated. [ 804.300844] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.301239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.301239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.301415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.302029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.316342] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: IN_PROGRESS for 2s [ 805.110848] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 805.111181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.154289] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 805.154585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.174709] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: SUCCESS [ 805.175410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.292064] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 805.292387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.331426] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: SUCCESS [ 806.331726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.331856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.332081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.332276] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.425116] env[66123]: INFO networking_nsxv3.common.synchronization [req-d7d4ee39-cfc1-48c2-a044-35ba7d1029e2 req-f97a44ca-5897-4bf3-8f00-8f6cc9230ba5 tempest-ListImageFiltersTestJSON-1076943688 tempest-ListImageFiltersTestJSON-1076943688-project-member] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 806.425116] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 806.425116] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=1, Passive=0], Jobs=1 [ 806.425116] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 806.426256] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.427281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.427512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.428207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.428543] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.428858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.430070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.430070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.430070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.430070] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.800029] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.800029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.800029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.800786] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.801526] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.801935] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.803307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.803307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.803307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.803307] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.803307] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.803589] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.803589] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.803589] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.803818] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.804193] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.825598] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.825598] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.825598] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.825855] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.826170] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.826345] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.826456] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.826874] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.827017] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f0f73a6-4e78-40d8-9b15-e53e8c7bae34',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.835395] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.835395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.835395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.835621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.835668] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.836238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.836238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.836238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.836398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.836398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.836460] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.931936] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.932237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.932357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.932721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.932928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.933255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.933442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.933530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.933893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.934053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.934190] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 already deleted. [ 806.934284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.330849] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.331097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.331199] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.331508] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.331942] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.331942] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 not found, creating... [ 807.332143] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.332307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.332422] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.332695] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.332847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.333190] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.333355] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.333469] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.333752] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.333905] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.334075] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 is going to be created. [ 807.340364] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.362046] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.362412] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.362627] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.363074] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.363483] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.363871] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.845477] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f94438f-58b5-4c82-8302-4f45a58dee50: rpc.has_security_group_logging(os_id): False [ 807.879874] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.880143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.880143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.880435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.880553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.881064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.881064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.881064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.881272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.881272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.881455] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 is going to be updated. [ 807.976660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.976870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.976870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.976988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.977191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.992500] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: IN_PROGRESS for 2s [ 808.047372] env[66123]: INFO networking_nsxv3.common.synchronization [req-aac9b322-3c9c-48b8-bdf5-f7975cb8b898 req-9792d933-4dab-4ed9-a697-407620ae73b5 tempest-ServersAdminNegativeTestJSON-1257558661 tempest-ServersAdminNegativeTestJSON-1257558661-project-member] Enqueued Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 808.049070] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd with Priority: HIGHEST for action security_group_members [ 808.050054] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.053604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.053604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.053604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.053604] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.057640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.057640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.057640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.057640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.057640] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8e203a-a322-44a7-8e22-6a43e3c9abbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.155814] env[66123]: INFO networking_nsxv3.common.synchronization [req-d7d4ee39-cfc1-48c2-a044-35ba7d1029e2 req-7ee8c119-71ae-4f57-8ffc-f45a40e9d7ea service nova] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_rules [ 808.156175] env[66123]: INFO networking_nsxv3.common.synchronization [req-d7d4ee39-cfc1-48c2-a044-35ba7d1029e2 req-7ee8c119-71ae-4f57-8ffc-f45a40e9d7ea service nova] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 808.156361] env[66123]: INFO networking_nsxv3.common.synchronization [req-d7d4ee39-cfc1-48c2-a044-35ba7d1029e2 req-7ee8c119-71ae-4f57-8ffc-f45a40e9d7ea service nova] Enqueued Resource ID: 5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 with Priority: HIGHEST for action port [ 808.156968] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_rules [ 808.157195] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 808.157306] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 with Priority: HIGHEST for action port [ 808.157625] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.157721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.157768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.158028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.158118] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.159322] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.159322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.159322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.159519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.159751] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.159880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.159960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.160344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.160344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.160344] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.162645] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.162645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.162645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.162645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.162645] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f0f73a6-4e78-40d8-9b15-e53e8c7bae34',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.560203] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.560203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.560203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.560815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.583181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.583461] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.583581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.583649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.583995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.584125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.584239] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd is going to be updated. [ 808.614389] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.615064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.615064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.615064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.615064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.624985] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: IN_PROGRESS for 2s [ 808.663634] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.664701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.664870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.665045] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 with status ACTIVE [ 808.665223] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.665343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.665423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.665610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.665675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.665859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.666056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.666150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.669809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.669977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.670227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.670376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.670453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.670579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.670640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.670734] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f0f73a6-4e78-40d8-9b15-e53e8c7bae34 is going to be updated. [ 808.697822] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.697822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.697822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.697822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.697822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.697822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f0f73a6-4e78-40d8-9b15-e53e8c7bae34" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.173314] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.679089] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.679089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.679089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.679089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.679089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.679089] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be created. [ 809.703526] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.703526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.703526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.703526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.703526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.715505] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: UNINITIALIZED for 2s [ 810.012767] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: SUCCESS [ 810.012767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.638036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd in Status: SUCCESS [ 810.638381] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8e203a-a322-44a7-8e22-6a43e3c9abbd deletion is rescheduled due to dependency. [ 810.638381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8e203a-a322-44a7-8e22-6a43e3c9abbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.467150] env[66123]: INFO networking_nsxv3.common.synchronization [req-5f9b9cc5-180d-44d6-a28c-21589407d6eb req-cf291410-b2da-4f82-9aec-6b8cd1d445ec tempest-ListImageFiltersTestJSON-1076943688 tempest-ListImageFiltersTestJSON-1076943688-project-member] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 811.468178] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 811.469598] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.469837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.728591] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: SUCCESS [ 811.728991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.729609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.729888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.730112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.730236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.730303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.730490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.730618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.730771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.730940] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.732651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.732874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.733125] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.733570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.733929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.734582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.734851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.735234] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.800286] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.800525] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.800604] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.801024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.801464] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.801664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.801830] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.802101] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.802308] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.802518] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.802649] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.802770] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.802880] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.803056] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.803195] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.803640] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.846425] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.848498] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 811.848498] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.848498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-68" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.848498] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-57576d5a-019b-49fc-b52d-27eabc8fca87 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.848498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.848498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.848498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.849124] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57576d5a-019b-49fc-b52d-27eabc8fca87',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.237342] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.237513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.237686] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.354598] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.354959] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.355048] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.355295] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.355453] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.355612] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 57576d5a-019b-49fc-b52d-27eabc8fca87 not found, creating... [ 812.355901] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.356322] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.356322] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.356487] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.356525] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.356808] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.356972] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.360091] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.360357] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.360498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.360649] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 57576d5a-019b-49fc-b52d-27eabc8fca87 is going to be created. [ 812.400743] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.401067] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.401250] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.401619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.402397] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.402397] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.740089] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.131150] env[66123]: INFO networking_nsxv3.common.synchronization [req-5f9b9cc5-180d-44d6-a28c-21589407d6eb req-0b721107-eb97-4043-b0aa-eb15b9d329e3 service nova] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_rules [ 813.131150] env[66123]: INFO networking_nsxv3.common.synchronization [req-5f9b9cc5-180d-44d6-a28c-21589407d6eb req-0b721107-eb97-4043-b0aa-eb15b9d329e3 service nova] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 813.131150] env[66123]: INFO networking_nsxv3.common.synchronization [req-5f9b9cc5-180d-44d6-a28c-21589407d6eb req-0b721107-eb97-4043-b0aa-eb15b9d329e3 service nova] Enqueued Resource ID: 57576d5a-019b-49fc-b52d-27eabc8fca87 with Priority: HIGHEST for action port [ 813.131150] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_rules [ 813.131150] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 813.131150] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57576d5a-019b-49fc-b52d-27eabc8fca87 with Priority: HIGHEST for action port [ 813.131150] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.132286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.134632] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.134632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.134632] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-57576d5a-019b-49fc-b52d-27eabc8fca87 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.134632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.134632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.134632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.134632] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57576d5a-019b-49fc-b52d-27eabc8fca87',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.244861] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.245061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.245188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.245371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.245450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.245554] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be updated. [ 813.296812] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.298775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.298775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.298775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.298775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.312490] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: IN_PROGRESS for 2s [ 813.376423] env[66123]: INFO networking_nsxv3.common.synchronization [req-9fdae399-a92f-4505-8849-278ed94d408a req-1947bd95-47fc-42e5-999e-6933f64d70aa tempest-ServersTestBootFromVolume-261050277 tempest-ServersTestBootFromVolume-261050277-project-member] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_members [ 813.377133] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGHEST for action security_group_members [ 813.377505] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.377659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.377737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.377990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.378174] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.378296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.378371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.378625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.378678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.378812] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.636375] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57576d5a-019b-49fc-b52d-27eabc8fca87 with status ACTIVE [ 813.636625] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.637258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.637258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.637258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.637258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.637453] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.637515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.637569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.637696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.637841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.638046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.638146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.638211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.638420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.638512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.638602] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57576d5a-019b-49fc-b52d-27eabc8fca87 is going to be updated. [ 813.666255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.666462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.666560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.666780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.667013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.667324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57576d5a-019b-49fc-b52d-27eabc8fca87" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.881528] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.881857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.881857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.881928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.882034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.882197] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.882293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.882350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.882507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.882584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.882739] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 is going to be updated. [ 813.915094] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.915094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.915094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.915094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.915094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.923927] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: IN_PROGRESS for 2s [ 814.153327] env[66123]: INFO networking_nsxv3.common.synchronization [req-207fbb24-59f7-448a-ac44-6086c5559007 req-a17870fe-d3da-4f7e-9e58-e428f1575423 tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 814.153327] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 814.154047] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.154047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.154047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.154266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.154266] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.154391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.154391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.154543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.154628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.154720] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.513149] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.513357] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.513480] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.513859] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.514136] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.514287] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.514397] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.514757] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.515022] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.515288] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.515432] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.515562] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.515689] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.515815] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.515941] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.516108] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.537924] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.538114] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.538252] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.538425] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.539251] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-cf0a6cf2-7891-4a3b-a125-9788826d54cf taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.539251] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.539251] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.539512] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.539512] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf0a6cf2-7891-4a3b-a125-9788826d54cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.658195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.658394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.658504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.658776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.658903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.659212] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.659379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.659459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.659632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.659712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.659802] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 already deleted. [ 814.659884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.041803] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.042167] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.042210] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.042583] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.042775] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.042976] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port cf0a6cf2-7891-4a3b-a125-9788826d54cf not found, creating... [ 815.043344] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.043516] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.043655] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.044119] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.044119] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.044415] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.044587] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.044727] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.044994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.045172] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.045321] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: cf0a6cf2-7891-4a3b-a125-9788826d54cf is going to be created. [ 815.069559] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.069770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.069900] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.070370] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.070705] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.070982] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.327930] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: SUCCESS [ 815.328424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.328484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.328720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.328916] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.329202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.329285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.329472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.329598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.329815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.329953] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.330122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.330122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.330304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.330533] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.330653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.330752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.330963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.331059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.331147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.331235] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.332402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.332577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.332752] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.332890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.332983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.333190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.333280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.333467] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.835395] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c98d0046-6918-47a2-9486-ba2fa2ba7743: rpc.has_security_group_logging(os_id): False [ 815.836596] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.861033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.861033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.861033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.861417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.861498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.861756] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.861872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.861912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.862111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.862188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.862402] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.862496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.862562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.862709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.862771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.862984] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.863125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.863460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.863460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.863460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.863723] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be created. [ 815.901443] env[66123]: INFO networking_nsxv3.common.synchronization [req-207fbb24-59f7-448a-ac44-6086c5559007 req-3d0ca1db-094a-4421-8174-ae43cf6ba26e service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 815.901925] env[66123]: INFO networking_nsxv3.common.synchronization [req-207fbb24-59f7-448a-ac44-6086c5559007 req-3d0ca1db-094a-4421-8174-ae43cf6ba26e service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 815.901925] env[66123]: INFO networking_nsxv3.common.synchronization [req-207fbb24-59f7-448a-ac44-6086c5559007 req-3d0ca1db-094a-4421-8174-ae43cf6ba26e service nova] Enqueued Resource ID: cf0a6cf2-7891-4a3b-a125-9788826d54cf with Priority: HIGHEST for action port [ 815.902286] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 815.902411] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 815.902512] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0a6cf2-7891-4a3b-a125-9788826d54cf with Priority: HIGHEST for action port [ 815.902842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.902957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.903035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.903438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.903532] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.904545] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.905136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.905259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.905479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.905637] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.905758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.905822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.906022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.906134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.906239] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.907301] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf0a6cf2-7891-4a3b-a125-9788826d54cf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.908244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.908366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.908596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.908686] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf0a6cf2-7891-4a3b-a125-9788826d54cf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.938646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.938838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.938892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.939217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.939457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.942723] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 in Status: SUCCESS [ 815.942961] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 deletion is rescheduled due to dependency. [ 815.943095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.960515] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: IN_PROGRESS for 2s [ 816.342035] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.410792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.410950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.411187] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.414184] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf0a6cf2-7891-4a3b-a125-9788826d54cf with status ACTIVE [ 816.414184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.414184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.414184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.414698] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.414698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.414698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.415806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.415919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.416121] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf0a6cf2-7891-4a3b-a125-9788826d54cf is going to be updated. [ 816.444328] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.444525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.444525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.444798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.445035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.445127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf0a6cf2-7891-4a3b-a125-9788826d54cf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.844436] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.844598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.844671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.844989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.845101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.845205] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be updated. [ 816.901488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.901652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.901820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.902080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.902177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.919385] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.922903] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: IN_PROGRESS for 2s [ 817.421675] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.421675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.421675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.422165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.422165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.422165] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be created. [ 817.450203] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.450357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.450431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.450658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.450820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.466276] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: UNINITIALIZED for 2s [ 817.976379] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: SUCCESS [ 817.976647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.976832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.977147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.978078] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.480470] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.480776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.714539] env[66123]: INFO networking_nsxv3.common.synchronization [req-fbc5de89-c191-49bf-84e5-7d0176cadb7b req-b8604c81-2b96-4e36-bd99-51a993783d4f tempest-ServersWithSpecificFlavorTestJSON-678692171 tempest-ServersWithSpecificFlavorTestJSON-678692171-project-member] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 818.715355] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 818.715355] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.715780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.715780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.715780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.715924] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.715924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.716029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.716870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.716870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.716870] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.938715] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: SUCCESS [ 818.938715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.938715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.938715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.938967] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.938967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.939118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.939392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.939392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.939392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.939641] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.219530] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.219682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.219748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.220078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.220184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.220425] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.220540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.221419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.221419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.221419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.221419] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be updated. [ 819.255915] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.256310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.256310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.256438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.256592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.279728] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: IN_PROGRESS for 2s [ 819.373829] env[66123]: INFO networking_nsxv3.common.synchronization [req-19394fc4-a641-44dd-8764-df8638aa8eaf req-9d71c215-0868-4951-8e42-20f2cfb1a9e5 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_members [ 819.374019] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_members [ 819.374331] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.374460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.374759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.374759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.374932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.375333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.375410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.375575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.375660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.375753] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.443069] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.443069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.443069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.443069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.443069] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.443069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.443069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.443678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.443730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.444055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.444150] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.444282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.444593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.446230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.447382] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.447456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.447542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.447782] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.447886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.447931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.448038] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.477792] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 819.479180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.479180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.479180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.479180] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.479508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.479508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.479575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.480895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.480895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.480895] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.821398] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.821656] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.821911] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.823217] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.824525] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.824797] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.825017] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.825330] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.825543] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.825836] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.826052] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.827188] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.827188] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.827188] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.827188] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.827188] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.851741] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.851934] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.852119] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.852310] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.852708] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-668f189d-a670-4b92-9944-36584e9e1ed0 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.852909] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.853060] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.853417] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.853580] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('668f189d-a670-4b92-9944-36584e9e1ed0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.878128] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.879079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.879079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.879079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.879079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.879410] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.879410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.879410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.879713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.879769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.879823] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48aac306-03a8-4928-8815-44ca0617408c already deleted. [ 819.879886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.954464] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c98d0046-6918-47a2-9486-ba2fa2ba7743: rpc.has_security_group_logging(os_id): False [ 819.983887] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.983887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.983887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.983887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.984526] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.984526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.984526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.984526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.984526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.984526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.984737] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.984791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.984823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.985076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.985154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.985246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.985285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.985405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.985480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.985664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.985664] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.994844] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.995137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.995137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.995413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.995413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.995627] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.995819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.995819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.996075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.996075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.996278] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.996374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.996495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.996578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.996652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.996852] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.996952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.997036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.997157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.997240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.997319] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be updated. [ 820.100397] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.100589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.100633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.100840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.100990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.128841] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: IN_PROGRESS for 2s [ 820.355913] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.356179] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.356303] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.356631] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.356743] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.356898] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 668f189d-a670-4b92-9944-36584e9e1ed0 not found, creating... [ 820.357174] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.357329] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.357438] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.357653] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.357785] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.358074] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.358221] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.358327] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.358518] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.358709] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.358768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 668f189d-a670-4b92-9944-36584e9e1ed0 is going to be created. [ 820.390660] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.390969] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.391181] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.391652] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.391860] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.392397] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.489607] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8: rpc.has_security_group_logging(os_id): False [ 820.513042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.513042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.513042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.513042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.513911] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.514473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.514699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.514942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.515192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.515383] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be created. [ 820.599575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.599575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.599575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.599575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.599575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.652521] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 821.070220] env[66123]: INFO networking_nsxv3.common.synchronization [req-d8804607-1b37-4aab-b6be-0e1bf5f61232 req-449e9a43-9b8b-4ea2-a20b-2d240ed60e97 tempest-ServerActionsV293TestJSON-94308629 tempest-ServerActionsV293TestJSON-94308629-project-member] Enqueued Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_members [ 821.071245] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGHEST for action security_group_members [ 821.071552] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.072618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.072618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.072618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.072618] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.072618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.072618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.072911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.072911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.072911] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.136575] env[66123]: INFO networking_nsxv3.common.synchronization [req-19394fc4-a641-44dd-8764-df8638aa8eaf req-c641fb7a-d2c1-4d3a-a367-02e84d43df9d service nova] Enqueued Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_rules [ 821.136575] env[66123]: INFO networking_nsxv3.common.synchronization [req-19394fc4-a641-44dd-8764-df8638aa8eaf req-c641fb7a-d2c1-4d3a-a367-02e84d43df9d service nova] Enqueued Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_members [ 821.136575] env[66123]: INFO networking_nsxv3.common.synchronization [req-19394fc4-a641-44dd-8764-df8638aa8eaf req-c641fb7a-d2c1-4d3a-a367-02e84d43df9d service nova] Enqueued Resource ID: 668f189d-a670-4b92-9944-36584e9e1ed0 with Priority: HIGHEST for action port [ 821.136575] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_rules [ 821.136575] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_members [ 821.136575] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 668f189d-a670-4b92-9944-36584e9e1ed0 with Priority: HIGHEST for action port [ 821.137078] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.137078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.137178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.138977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.138977] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.138977] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.138977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.138977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.138977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.139529] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.139529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.139529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.139529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.139529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.139695] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.140519] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-668f189d-a670-4b92-9944-36584e9e1ed0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.140644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.140714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.140865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.140994] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('668f189d-a670-4b92-9944-36584e9e1ed0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.324203] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 821.324384] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc deletion is rescheduled due to dependency. [ 821.324462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.361981] env[66123]: INFO networking_nsxv3.common.synchronization [None req-07ef0223-c5dc-45f5-af99-3100ea48b718 None None] Enqueued Resource ID: c987c721-a8dc-4fae-a0fd-5179dee763d7 with Priority: HIGHEST for action port [ 821.361981] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c987c721-a8dc-4fae-a0fd-5179dee763d7 with Priority: HIGHEST for action port [ 821.362279] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-c987c721-a8dc-4fae-a0fd-5179dee763d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.362279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c987c721-a8dc-4fae-a0fd-5179dee763d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.362460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c987c721-a8dc-4fae-a0fd-5179dee763d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.363177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c987c721-a8dc-4fae-a0fd-5179dee763d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.363177] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c987c721-a8dc-4fae-a0fd-5179dee763d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.576280] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.576862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.576862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.576862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.601442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.601788] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.602291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.602291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.602457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.602457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.602576] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 is going to be updated. [ 821.630605] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.630762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.630859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.631120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.631267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.645394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 in Status: IN_PROGRESS for 2s [ 821.645797] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.645797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.645797] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.646910] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 668f189d-a670-4b92-9944-36584e9e1ed0 with status ACTIVE [ 821.647046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.647172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.647172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.647380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.647468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.647659] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.647755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.647816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.647997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.648066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.648251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.648345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.648403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.648544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.648614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.648693] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 668f189d-a670-4b92-9944-36584e9e1ed0 is going to be updated. [ 821.673207] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.673431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.673431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.673638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.674188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.674947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-668f189d-a670-4b92-9944-36584e9e1ed0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.865268] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c987c721-a8dc-4fae-a0fd-5179dee763d7 [ 821.865268] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.865679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.865890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.867827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.868090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.868256] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c987c721-a8dc-4fae-a0fd-5179dee763d7 already deleted. [ 821.868854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c987c721-a8dc-4fae-a0fd-5179dee763d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.124512] env[66123]: INFO networking_nsxv3.common.synchronization [req-d73f6c35-a992-48c5-8b69-a06eb018b675 req-296bd821-db42-4963-a7fe-d9ac279cda6d tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 822.125199] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 822.126797] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.126797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.126797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.126797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.126797] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.127460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.127460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.127460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.127586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.127619] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.143656] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: SUCCESS [ 822.143656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.152635] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.630889] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.656445] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.656643] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.656766] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.657076] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.657338] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.657496] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.657917] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.657917] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.658029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.658299] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.658299] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.658372] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.658472] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.658577] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.658696] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.658901] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.660064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.660182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.660250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.660407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.660491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.660583] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48aac306-03a8-4928-8815-44ca0617408c is going to be created. [ 822.678543] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 822.678765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.684730] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.685806] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.685982] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.686088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.686475] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-f77f2c3b-3272-442b-a432-04e8f48a2931 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.686664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.686781] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.687128] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.687270] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77f2c3b-3272-442b-a432-04e8f48a2931',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.693717] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.693919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.694101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.694167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.694326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.705312] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48aac306-03a8-4928-8815-44ca0617408c in Status: UNINITIALIZED for 2s [ 823.134193] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.190572] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.191256] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.191256] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.191256] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.191634] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.191634] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port f77f2c3b-3272-442b-a432-04e8f48a2931 not found, creating... [ 823.193261] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.193261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.193261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.193261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.193261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.193261] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.193261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.193261] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.194051] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.194051] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.194051] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: f77f2c3b-3272-442b-a432-04e8f48a2931 is going to be created. [ 823.217020] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.217310] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.217434] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.217728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.218051] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.218338] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.636614] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.637135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.637135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.637135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.637329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.637435] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 823.654359] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 in Status: SUCCESS [ 823.654605] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 deletion is rescheduled due to dependency. [ 823.654683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.682247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.682507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.682588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.683053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.683216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.695922] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 823.999252] env[66123]: INFO networking_nsxv3.common.synchronization [req-d73f6c35-a992-48c5-8b69-a06eb018b675 req-419388d5-f747-4c33-afa4-b5ac4734b1b1 service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 823.999454] env[66123]: INFO networking_nsxv3.common.synchronization [req-d73f6c35-a992-48c5-8b69-a06eb018b675 req-419388d5-f747-4c33-afa4-b5ac4734b1b1 service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 823.999831] env[66123]: INFO networking_nsxv3.common.synchronization [req-d73f6c35-a992-48c5-8b69-a06eb018b675 req-419388d5-f747-4c33-afa4-b5ac4734b1b1 service nova] Enqueued Resource ID: f77f2c3b-3272-442b-a432-04e8f48a2931 with Priority: HIGHEST for action port [ 824.000143] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 824.000274] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 824.000367] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77f2c3b-3272-442b-a432-04e8f48a2931 with Priority: HIGHEST for action port [ 824.000640] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.000794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.001841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.001841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.001841] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.002256] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.002367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.002532] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-f77f2c3b-3272-442b-a432-04e8f48a2931 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.002621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.002679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.002855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.002936] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77f2c3b-3272-442b-a432-04e8f48a2931',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.455049] env[66123]: INFO networking_nsxv3.common.synchronization [None req-25d77c64-d625-4cff-8102-d0d3033e67ca None None] Enqueued Resource ID: 4d176001-b949-4b6a-a3cf-ab3cb399d76c with Priority: HIGHEST for action port [ 824.455049] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d176001-b949-4b6a-a3cf-ab3cb399d76c with Priority: HIGHEST for action port [ 824.455049] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d176001-b949-4b6a-a3cf-ab3cb399d76c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.455049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d176001-b949-4b6a-a3cf-ab3cb399d76c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.455049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d176001-b949-4b6a-a3cf-ab3cb399d76c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.455049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d176001-b949-4b6a-a3cf-ab3cb399d76c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.455049] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d176001-b949-4b6a-a3cf-ab3cb399d76c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.507681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.507681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.509073] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f77f2c3b-3272-442b-a432-04e8f48a2931 with status ACTIVE [ 824.510233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.510233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.510233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.510939] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.510939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.510939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.510939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.510939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.510939] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f77f2c3b-3272-442b-a432-04e8f48a2931 is going to be updated. [ 824.537547] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.538628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.538628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.538628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.538628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.538628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f77f2c3b-3272-442b-a432-04e8f48a2931" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.717953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48aac306-03a8-4928-8815-44ca0617408c in Status: SUCCESS [ 824.717953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.718362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.720201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.720201] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.720201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.720201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.720201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.720201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.720201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.720201] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.957343] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d176001-b949-4b6a-a3cf-ab3cb399d76c [ 824.957609] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.957758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.957833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.958126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.958261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.958405] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d176001-b949-4b6a-a3cf-ab3cb399d76c already deleted. [ 824.958684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d176001-b949-4b6a-a3cf-ab3cb399d76c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.222393] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.708538] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 825.709040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.709203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.709419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.709641] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.709810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.709906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.710130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.710231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.710327] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.725137] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48aac306-03a8-4928-8815-44ca0617408c: rpc.has_security_group_logging(os_id): False [ 825.747729] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.747976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.747976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.749666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.749666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.749666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.749666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.749666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.749666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.749666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.749666] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48aac306-03a8-4928-8815-44ca0617408c is going to be created. [ 825.828398] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.828398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.828398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.828860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.829718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.845868] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48aac306-03a8-4928-8815-44ca0617408c in Status: IN_PROGRESS for 2s [ 826.213489] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.717849] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.223579] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.223920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.223920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.224167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.227148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.227148] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 827.261458] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.261458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.261458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.262149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.262149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.274484] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 827.878565] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48aac306-03a8-4928-8815-44ca0617408c in Status: SUCCESS [ 827.879097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.309037] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 829.309037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.309422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.309422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.309603] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.309729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.309923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.310125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.310218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.310322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.310467] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.455123] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 829.455351] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 829.816545] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.816711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.816780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.817069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.817294] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.817421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.817496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.817701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.817785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.817876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.818150] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.818150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.818232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.818353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.818489] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.818577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.818635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.818768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.818838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.818921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.819015] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.321437] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 830.346824] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.346995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.347068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.347266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.347358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.347568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.347639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.347722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.347841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.347916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.348133] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.348232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.348286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.348427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.348501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.348693] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.348770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.348828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.349022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.349107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.349196] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 830.418261] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.418422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.418493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.418705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.418854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.435015] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 832.454277] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 832.454644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.456444] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 834.456444] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 835.964325] env[66123]: INFO networking_nsxv3.common.synchronization [req-1517501e-eada-4fa7-bfab-f2aacba04d48 req-c45e9940-8ecd-49b9-bffb-1d12c238cbeb tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 835.965035] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 835.965678] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.965951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.966115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.966379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.966611] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.966730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.966895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.967040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.967136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.967232] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.042492] env[66123]: INFO networking_nsxv3.common.synchronization [req-7a667d9b-04a9-476d-a0a8-41526f4e93ea req-b8db0b2c-0661-404c-9230-9d69c10826c9 tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 836.043145] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 836.043481] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.043611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.043680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.043881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.044126] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.044228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.044296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.044489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.044595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.044742] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.470038] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.513545] env[66123]: INFO networking_nsxv3.common.synchronization [req-b61afa39-0a3a-4ac6-8b3c-ca37fa2b4ce9 req-9bc285f7-e236-4c93-9924-3f0a89a6b078 tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 836.514493] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 836.514816] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.514955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.515063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.515328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.515609] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.515609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.515744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.515799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.515870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.515960] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.547174] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.938361] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.938575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.938668] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.938993] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.939267] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.939428] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.939529] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.939733] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.939873] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.940276] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.940410] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.940520] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.940659] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.940774] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.940838] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.940972] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.963332] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.963579] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.963795] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.964090] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.964525] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.964813] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.964914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.965286] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.965425] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.972366] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.019466] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.019603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.019737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.020038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.020179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.020474] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.020625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.020720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.020943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.021088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.021218] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d already deleted. [ 837.021342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.049493] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.468934] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.469080] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.469286] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.469626] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.469864] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.470104] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 not found, creating... [ 837.470455] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.470678] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.470839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.471205] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.471385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.471757] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.472045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.472180] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.472405] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.472553] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.472706] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 is going to be created. [ 837.474015] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.474151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.474219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.474369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.474461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.474553] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 837.498056] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.498207] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.498870] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.498870] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.498870] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.499119] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.515982] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.516160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.516228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.516446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.516600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.529319] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 837.551549] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.551711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.551790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.552126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.552126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.552249] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 837.579888] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.580054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.580133] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.580668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.580852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.609300] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 838.250691] env[66123]: INFO networking_nsxv3.common.synchronization [req-b61afa39-0a3a-4ac6-8b3c-ca37fa2b4ce9 req-2bc434e1-6035-4399-a41b-6ff1718a1308 service nova] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_rules [ 838.251022] env[66123]: INFO networking_nsxv3.common.synchronization [req-b61afa39-0a3a-4ac6-8b3c-ca37fa2b4ce9 req-2bc434e1-6035-4399-a41b-6ff1718a1308 service nova] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 838.251080] env[66123]: INFO networking_nsxv3.common.synchronization [req-b61afa39-0a3a-4ac6-8b3c-ca37fa2b4ce9 req-2bc434e1-6035-4399-a41b-6ff1718a1308 service nova] Enqueued Resource ID: 11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 with Priority: HIGHEST for action port [ 838.251604] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_rules [ 838.251737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 838.251833] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 with Priority: HIGHEST for action port [ 838.252142] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.252267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.252330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.252599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.252685] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.253596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.253756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.253878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.254249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.254568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.254719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.254796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.254965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.255072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.255168] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.256052] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.256183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.256246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.256410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.256520] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.761265] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.761265] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.761265] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 with status ACTIVE [ 838.761265] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.761265] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.761265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.763179] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.763493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.763665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.763984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.764190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.764404] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472 is going to be updated. [ 838.788274] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.788787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.789011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.789347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.789594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.790024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11b0ddfc-3b92-4f7a-be2a-c1eed6cf6472" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.217738] env[66123]: INFO networking_nsxv3.common.synchronization [req-e74dd526-2c6c-4d37-b7b5-6e11c921291b req-3e12e9e5-7d1f-496b-8c36-e1e2bb4546c1 tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 839.218343] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 839.218664] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.218775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.266924] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.522673] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.522919] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.523065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.523340] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.523643] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.523772] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.523887] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.524143] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.524309] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.524526] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.524637] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.524742] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.524847] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.524966] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.525099] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.525231] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.538873] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 839.539221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.549539] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.549788] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.549874] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.550069] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.550407] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-437b3bb5-f23b-4250-b5f5-e1409cce4db3 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.550574] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.550691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.551050] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.551197] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('437b3bb5-f23b-4250-b5f5-e1409cce4db3',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.620371] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 839.620856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.769729] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.769955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.769955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.770307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.770307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.770609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be created. [ 839.796868] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.797113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.797233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.797848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.797848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.809180] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: UNINITIALIZED for 2s [ 840.057033] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.057033] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 437b3bb5-f23b-4250-b5f5-e1409cce4db3 not found, creating... [ 840.057033] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.057033] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.057671] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.057671] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.057671] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.057671] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.058073] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.058443] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 437b3bb5-f23b-4250-b5f5-e1409cce4db3 is going to be created. [ 840.093902] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.093902] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.093902] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.093902] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.093902] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.093902] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.783032] env[66123]: INFO networking_nsxv3.common.synchronization [req-e74dd526-2c6c-4d37-b7b5-6e11c921291b req-02c020f4-0a49-4b37-b388-11293e45609b service nova] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_rules [ 840.783032] env[66123]: INFO networking_nsxv3.common.synchronization [req-e74dd526-2c6c-4d37-b7b5-6e11c921291b req-02c020f4-0a49-4b37-b388-11293e45609b service nova] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 840.783032] env[66123]: INFO networking_nsxv3.common.synchronization [req-e74dd526-2c6c-4d37-b7b5-6e11c921291b req-02c020f4-0a49-4b37-b388-11293e45609b service nova] Enqueued Resource ID: 437b3bb5-f23b-4250-b5f5-e1409cce4db3 with Priority: HIGHEST for action port [ 840.783649] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_rules [ 840.783818] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 840.783930] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437b3bb5-f23b-4250-b5f5-e1409cce4db3 with Priority: HIGHEST for action port [ 840.784455] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.784562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.785517] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.785628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.785839] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-437b3bb5-f23b-4250-b5f5-e1409cce4db3 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.785988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.786051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.786981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.786981] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('437b3bb5-f23b-4250-b5f5-e1409cce4db3',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.289094] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 437b3bb5-f23b-4250-b5f5-e1409cce4db3 with status ACTIVE [ 841.289435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.289632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.290282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.290282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.290282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.290282] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.290556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.290556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.290556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.290760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.290914] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.290999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.290999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.291266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.291336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.291428] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 437b3bb5-f23b-4250-b5f5-e1409cce4db3 is going to be updated. [ 841.318752] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.319010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.319074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.319309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.319499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.319718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-437b3bb5-f23b-4250-b5f5-e1409cce4db3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.819999] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 841.820280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.820668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.820750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.821346] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.821346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.821346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.821346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.821579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.821579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.821579] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.822607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.822876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.822876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.823359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.823359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.823359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.823359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.823568] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.830879] env[66123]: INFO networking_nsxv3.common.synchronization [req-4873f00a-3bd7-41f1-a255-1d2b250e97a8 req-beb29699-4727-4299-b6ac-56c58fca6d5a tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 841.831465] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 841.831763] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.831878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.831943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.832166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.832283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.832380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.832438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.832623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.832670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.832739] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.221910] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.221910] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.222111] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.222406] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.222806] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.223268] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.223445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.223680] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.223828] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.224077] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.224199] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.224302] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.224406] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.224550] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.224663] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.224791] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.259138] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.259360] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.259502] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.259696] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.260028] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-676ebd9d-a828-4964-b6be-4f0e18936d42 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.260202] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.260320] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.260661] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.260838] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('676ebd9d-a828-4964-b6be-4f0e18936d42',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.325829] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.325829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.328714] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.335993] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.336330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.336488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.337304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.337304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.337304] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.337541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.337541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.337699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.337897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.338037] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be deleted. [ 842.379887] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.379998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.379998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.380333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.380433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.380624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.763996] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.764448] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.764659] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.765133] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.765347] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.765559] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 676ebd9d-a828-4964-b6be-4f0e18936d42 not found, creating... [ 842.765918] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.766174] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.766328] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.766632] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.766836] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.767331] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.767593] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.767793] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.768126] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.768320] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.768543] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 676ebd9d-a828-4964-b6be-4f0e18936d42 is going to be created. [ 842.794821] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.795165] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.795300] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.795615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.795862] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.796162] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.831367] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.333952] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.333952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.333952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.334158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.334270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.334969] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be updated. [ 843.369216] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.369387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.369468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.369648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.369772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.381414] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: IN_PROGRESS for 2s [ 843.525340] env[66123]: INFO networking_nsxv3.common.synchronization [req-4873f00a-3bd7-41f1-a255-1d2b250e97a8 req-ffdc6622-a799-44bc-ad60-ed4706166ef7 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 843.525520] env[66123]: INFO networking_nsxv3.common.synchronization [req-4873f00a-3bd7-41f1-a255-1d2b250e97a8 req-ffdc6622-a799-44bc-ad60-ed4706166ef7 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 843.525655] env[66123]: INFO networking_nsxv3.common.synchronization [req-4873f00a-3bd7-41f1-a255-1d2b250e97a8 req-ffdc6622-a799-44bc-ad60-ed4706166ef7 service nova] Enqueued Resource ID: 676ebd9d-a828-4964-b6be-4f0e18936d42 with Priority: HIGHEST for action port [ 843.526220] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 843.526913] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 843.526913] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 676ebd9d-a828-4964-b6be-4f0e18936d42 with Priority: HIGHEST for action port [ 843.526913] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.526913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.526913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.527326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.527326] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.528133] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.528258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.528324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.528512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.528669] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.528769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.528838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.528995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.529104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.529203] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.530322] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-676ebd9d-a828-4964-b6be-4f0e18936d42 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.530447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.531037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.531037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.531037] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('676ebd9d-a828-4964-b6be-4f0e18936d42',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.032892] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.033272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.033272] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.034301] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 676ebd9d-a828-4964-b6be-4f0e18936d42 with status ACTIVE [ 844.034400] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.034480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.034549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.034752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.034853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.035040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.035134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.035197] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.035345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.035474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.035890] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.035890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.035890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.036330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.036330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.036330] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 676ebd9d-a828-4964-b6be-4f0e18936d42 is going to be updated. [ 844.072903] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.073058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.073203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.073464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.073609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.074192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-676ebd9d-a828-4964-b6be-4f0e18936d42" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.436065] env[66123]: INFO networking_nsxv3.common.synchronization [req-3291f8a3-ad7f-4d85-af1a-2091421df338 req-4e85153a-c820-479c-a3b1-fa141e36bdae tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 844.436654] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 844.436963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.437182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.437260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.437506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.437670] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.437774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.437831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.437974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.438112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.438159] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.538807] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.803373] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-4 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.803592] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.803721] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.804142] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.804446] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.804651] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.804781] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.805717] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.807239] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.807239] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.807368] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.807505] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.808062] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.808062] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.808062] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.808062] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.836024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.836024] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.836024] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.836024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.836024] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-54351622-2e46-4b3d-b5a9-22f40c5a9b50 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.836024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.836024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.836024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.836024] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54351622-2e46-4b3d-b5a9-22f40c5a9b50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.939990] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.940297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.940416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.940696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.940792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.941137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.941279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.941344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.941543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.941630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.941721] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d already deleted. [ 844.941966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.042919] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.043269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.043338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.043627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.043725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.043847] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be created. [ 845.083698] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.083698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.083698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.083698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.083698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.098863] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: UNINITIALIZED for 2s [ 845.338314] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.338696] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.338906] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.339259] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.339406] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.339562] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 54351622-2e46-4b3d-b5a9-22f40c5a9b50 not found, creating... [ 845.339878] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.340092] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.340216] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.340480] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.340619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.340948] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.341171] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.341352] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.341732] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.341852] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.342063] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 is going to be created. [ 845.370518] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.370869] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.371243] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.372601] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.372601] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.372601] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.497362] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 845.497655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.497847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.498083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.498280] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.498404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.498470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.498629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.498717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.498812] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.000964] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.149121] env[66123]: INFO networking_nsxv3.common.synchronization [req-3291f8a3-ad7f-4d85-af1a-2091421df338 req-9defe45f-53fa-4477-9057-c66471e4bd24 service nova] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_rules [ 846.149481] env[66123]: INFO networking_nsxv3.common.synchronization [req-3291f8a3-ad7f-4d85-af1a-2091421df338 req-9defe45f-53fa-4477-9057-c66471e4bd24 service nova] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 846.149481] env[66123]: INFO networking_nsxv3.common.synchronization [req-3291f8a3-ad7f-4d85-af1a-2091421df338 req-9defe45f-53fa-4477-9057-c66471e4bd24 service nova] Enqueued Resource ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with Priority: HIGHEST for action port [ 846.150183] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_rules [ 846.150326] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 846.150449] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with Priority: HIGHEST for action port [ 846.150777] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.150930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.151046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.151320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.151447] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.152849] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.153010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.153123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.153325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.153639] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.153778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.153847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.154071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.154173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.154381] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.155964] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-54351622-2e46-4b3d-b5a9-22f40c5a9b50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.156097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.156258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.156350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.156454] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54351622-2e46-4b3d-b5a9-22f40c5a9b50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.503604] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.654742] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.654940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.656411] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.661093] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with status ACTIVE [ 846.661093] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.661093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.661093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.661384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.661384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.661582] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.661582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.661582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.661700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.661787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.662033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.662126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.662176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.662368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.662368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.662455] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 is going to be updated. [ 846.691673] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.691778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.691889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.692289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.692520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.692869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.008751] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.008751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.008751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.008751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.008751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.008751] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be updated. [ 847.046696] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.046987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.047116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.047352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.047514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.060641] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: IN_PROGRESS for 2s [ 847.112243] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 847.113029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.113029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.113029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.113321] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.113321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.114074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.114074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.114074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.114074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.114074] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.160263] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.617332] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.617537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.617635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.617885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.618632] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.619011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.619141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.620046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.620186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.620315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.620547] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.621280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.621280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.621531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.621702] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.622422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.622532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.622730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.622855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.623157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.623622] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.665126] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.665390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.665467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.665697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.665789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.665890] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be created. [ 847.691601] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.691807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.691807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.692055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.692228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.702688] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: UNINITIALIZED for 2s [ 847.847029] env[66123]: INFO networking_nsxv3.common.synchronization [req-9d4bac6f-5b5c-4a42-9eb9-9b31666dab46 req-c68f6561-c8ad-4abf-9f3f-1dd032955b3c tempest-ServersTestFqdnHostnames-1930379483 tempest-ServersTestFqdnHostnames-1930379483-project-member] Enqueued Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_members [ 847.847029] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGHEST for action security_group_members [ 847.847029] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.847029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.847029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.847711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.848223] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.848517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.848744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.849649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.849649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.849649] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.127785] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b3e626-c03f-466a-b911-e8ab22cc99de: rpc.has_security_group_logging(os_id): False [ 848.150253] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.150253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.150253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.150510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.150510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.150648] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.150736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.150810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.150958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.151057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.151255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.151368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.151421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.151538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.151611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.151799] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.151895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.151963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.152600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.152713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.152807] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be created. [ 848.223159] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.223159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.223159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.223159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.223159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.237408] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 848.354592] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.354592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.354592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.354592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.383052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.383052] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.383052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.383052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.383052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.383052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.383052] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a is going to be updated. [ 848.429941] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.431121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.431121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.431355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.431637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.450523] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a in Status: IN_PROGRESS for 2s [ 849.072052] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 849.072264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.072437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.072652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.072903] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.073048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.073120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.073281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.073372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.073463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.073677] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.073874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.073874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.074092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.074197] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.074264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.074306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.074435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.074508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.074587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.074674] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.173738] env[66123]: INFO networking_nsxv3.common.synchronization [req-28623234-8fe8-431a-be7f-25b26a07950d req-125d218a-803b-4365-a21a-40410f7038e9 tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 849.174657] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 849.174983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.175138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.175204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.175802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.175802] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.175802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.175802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.176360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.176360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.176360] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.577217] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e086d7-22eb-4e20-9dda-bdb801fe920d: rpc.has_security_group_logging(os_id): False [ 849.600489] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.600695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.600695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.600981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.601127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.601452] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.601563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.601642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.601815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.601919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.602177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.602267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.602343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.602686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.602686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.602845] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.602845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.602954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.603031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.603119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.603218] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be created. [ 849.663091] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.663270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.663270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.663484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.663699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.678553] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: IN_PROGRESS for 2s [ 849.678943] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.679093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.679151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.679375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.679483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.679688] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.679792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.679856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.680019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.680098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.680183] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 849.713520] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 849.713520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.713520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.713520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.713859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.713859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.713859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.714080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.714130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.714214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.714323] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.718061] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.718061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.718061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.718061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.718061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.728899] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 850.220120] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.220120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.220120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.220120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.220120] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.220120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.220120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.220120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.220120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.220646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.220646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.220646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.220646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.220799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.221519] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.221519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.221519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.226398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.226398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.226398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.226398] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.265666] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 850.265666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.463139] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a in Status: SUCCESS [ 850.463287] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a deletion is rescheduled due to dependency. [ 850.463386] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.628302] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab84752-282a-4576-a250-b1627d40cb70 req-e9a162c6-5dda-4d85-9a39-21c7e09b3804 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 850.629321] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 850.629923] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.630085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.630166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.630516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.630660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.630836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.630929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.631146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.631287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.631452] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.729582] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90668e0f-9991-480a-b163-29326b17781d: rpc.has_security_group_logging(os_id): False [ 850.748349] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.748547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.748547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.748762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.748856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.749100] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.749209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.749253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.749408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.749485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.749653] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.749744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.749804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.749940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.750021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.750196] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.750350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.750350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.750472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.750544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.750627] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be created. [ 850.810631] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.810845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.810894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.811647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.811647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.824020] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: IN_PROGRESS for 2s [ 850.986167] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.986388] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.986524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.986800] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.987298] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.988938] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.989100] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.989352] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.989500] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.989712] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.989823] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.989926] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.990032] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.990194] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.990254] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.990367] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.011461] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.011629] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.011772] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.011992] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.012366] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.012571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.012690] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.013187] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.013187] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b9f382-e63d-4750-aa9b-41f3c0a3babf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.134112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.134311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.134390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.134618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.134705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.134905] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.135007] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.135092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.135423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.135523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.135622] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 already deleted. [ 851.135710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.519024] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.519024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port b9b9f382-e63d-4750-aa9b-41f3c0a3babf not found, creating... [ 851.519024] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.519024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.519644] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.519644] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.519644] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.519644] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.519644] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.520057] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: b9b9f382-e63d-4750-aa9b-41f3c0a3babf is going to be created. [ 851.542795] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.542968] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.543083] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.543387] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.543661] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.544277] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.697492] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 851.697492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.697492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.697492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.698318] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.739662] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 851.739949] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 deletion is rescheduled due to dependency. [ 851.740094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.200795] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.201206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.201306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.202468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.202782] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.202923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.202962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.203732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.203732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.203732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.203732] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.318488] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab84752-282a-4576-a250-b1627d40cb70 req-6d364e88-c9b7-47b0-ae26-f536959c5390 service nova] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_rules [ 852.318488] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab84752-282a-4576-a250-b1627d40cb70 req-6d364e88-c9b7-47b0-ae26-f536959c5390 service nova] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 852.318488] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab84752-282a-4576-a250-b1627d40cb70 req-6d364e88-c9b7-47b0-ae26-f536959c5390 service nova] Enqueued Resource ID: b9b9f382-e63d-4750-aa9b-41f3c0a3babf with Priority: HIGHEST for action port [ 852.318488] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_rules [ 852.318488] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 852.318488] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b9f382-e63d-4750-aa9b-41f3c0a3babf with Priority: HIGHEST for action port [ 852.319239] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.319517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.319709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.320149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.320347] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.321498] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.321728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.321904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.322248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.323144] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.323274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.323368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.323603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.323707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.323824] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.325036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.325036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.325036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.325352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.325352] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b9f382-e63d-4750-aa9b-41f3c0a3babf',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.706464] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.706802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.706802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.707036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.707198] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.707343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.707437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.707567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.707655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.707741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.707953] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.708070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.708124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.708252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.708389] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.708482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.708562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.708725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.708823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.708911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.709008] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.828976] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.829122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.829316] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9b9f382-e63d-4750-aa9b-41f3c0a3babf with status ACTIVE [ 852.831022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.831022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.831022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.831022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.831949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.831949] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9b9f382-e63d-4750-aa9b-41f3c0a3babf is going to be updated. [ 852.832606] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.841915] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 852.841915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.858526] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.858885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.858885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.859166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.859341] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.859624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9b9f382-e63d-4750-aa9b-41f3c0a3babf" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.212412] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e086d7-22eb-4e20-9dda-bdb801fe920d: rpc.has_security_group_logging(os_id): False [ 853.240987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.240987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.240987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.240987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.242388] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.242388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.242388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.242388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.242388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.242388] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be updated. [ 853.319103] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.319288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.319371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.319615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.319767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.336023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.341394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: IN_PROGRESS for 2s [ 853.838217] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.838550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.838550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.838735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.838853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.838957] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be created. [ 853.862596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.862848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.862936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.863209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.863374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.873512] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: UNINITIALIZED for 2s [ 855.360770] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 855.361140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.891670] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: SUCCESS [ 855.891958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.892157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.892614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.892878] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.893026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.893088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.893471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.893471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.893471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.893724] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.137381] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e4a05ba8-4a3f-42ea-9ff7-63b5914d48fc None None] Enqueued Resource ID: 859e0952-e598-41ec-ac42-c45118ffca6c with Priority: HIGHEST for action port [ 856.137944] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859e0952-e598-41ec-ac42-c45118ffca6c with Priority: HIGHEST for action port [ 856.138275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-859e0952-e598-41ec-ac42-c45118ffca6c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.138402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-859e0952-e598-41ec-ac42-c45118ffca6c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.138470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-859e0952-e598-41ec-ac42-c45118ffca6c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.139031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-859e0952-e598-41ec-ac42-c45118ffca6c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.139031] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('859e0952-e598-41ec-ac42-c45118ffca6c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.397148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.397719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.397719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.397719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.397861] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.398037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.398037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.398225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.398458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.398458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.398584] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.398682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.398746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.398888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.399104] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.399206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.399206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.399348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.399432] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.399543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.399639] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.642341] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 859e0952-e598-41ec-ac42-c45118ffca6c [ 856.642811] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.642811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.642811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.643028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.643028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.643453] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:859e0952-e598-41ec-ac42-c45118ffca6c already deleted. [ 856.643453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-859e0952-e598-41ec-ac42-c45118ffca6c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.902032] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4: rpc.has_security_group_logging(os_id): False [ 856.929108] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.929108] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.929108] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.929108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.930378] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.930378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.930378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.930378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.930378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.930378] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be created. [ 857.028246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.028246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.028246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.028246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.028246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.044139] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: IN_PROGRESS for 2s [ 858.678913] env[66123]: INFO networking_nsxv3.common.synchronization [None req-928cae37-d9b9-4609-bada-80a46325e6e5 None None] Enqueued Resource ID: 499cf60a-3262-4166-9ce2-00531a51c275 with Priority: HIGHEST for action port [ 858.679592] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 499cf60a-3262-4166-9ce2-00531a51c275 with Priority: HIGHEST for action port [ 858.679975] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-499cf60a-3262-4166-9ce2-00531a51c275 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.680216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-499cf60a-3262-4166-9ce2-00531a51c275" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.680300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-499cf60a-3262-4166-9ce2-00531a51c275" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.680638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-499cf60a-3262-4166-9ce2-00531a51c275" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.680799] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('499cf60a-3262-4166-9ce2-00531a51c275',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.058861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: SUCCESS [ 859.059327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.182849] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 499cf60a-3262-4166-9ce2-00531a51c275 [ 859.182996] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.183166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.183236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.183594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.183594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.183696] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:499cf60a-3262-4166-9ce2-00531a51c275 already deleted. [ 859.183783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-499cf60a-3262-4166-9ce2-00531a51c275" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.788703] env[66123]: INFO networking_nsxv3.common.synchronization [req-caa3ae61-8a21-4a3f-9415-91ca7545afc2 req-b32b6047-9a33-4487-99ec-7070c104e6b8 tempest-ImagesOneServerTestJSON-1373675140 tempest-ImagesOneServerTestJSON-1373675140-project-member] Enqueued Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_members [ 859.789337] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_members [ 859.789698] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.789830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.789913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.790741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.790741] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.790888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.790888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.791257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.791474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.791577] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.255207] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.255399] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.255534] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.256071] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.256396] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.256619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.256763] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.256977] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.257135] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.257446] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.257601] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.257752] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.258084] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.258084] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.258189] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.258578] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.279104] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.279387] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.279467] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.279633] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.279971] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-9e4a089b-da29-4c14-9782-4d787e222138 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.280135] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.280252] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.280575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.280775] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e4a089b-da29-4c14-9782-4d787e222138',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.295210] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.295389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.295520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.295676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.295767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.295973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.296086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.296163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.296288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.296363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.296535] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 already deleted. [ 860.296621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.785688] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.785688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.785688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.785688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.785688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.785688] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 9e4a089b-da29-4c14-9782-4d787e222138 not found, creating... [ 860.785688] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.785688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.785688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.785688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.786189] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.786189] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.786905] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.789592] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.791408] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.791408] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.791408] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 9e4a089b-da29-4c14-9782-4d787e222138 is going to be created. [ 860.815889] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.816171] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.816300] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.816609] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.816857] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.817685] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.606237] env[66123]: INFO networking_nsxv3.common.synchronization [req-caa3ae61-8a21-4a3f-9415-91ca7545afc2 req-aaad8888-a8ee-48ab-98e3-cfdd4098f4ae service nova] Enqueued Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_rules [ 861.606546] env[66123]: INFO networking_nsxv3.common.synchronization [req-caa3ae61-8a21-4a3f-9415-91ca7545afc2 req-aaad8888-a8ee-48ab-98e3-cfdd4098f4ae service nova] Enqueued Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_members [ 861.606765] env[66123]: INFO networking_nsxv3.common.synchronization [req-caa3ae61-8a21-4a3f-9415-91ca7545afc2 req-aaad8888-a8ee-48ab-98e3-cfdd4098f4ae service nova] Enqueued Resource ID: 9e4a089b-da29-4c14-9782-4d787e222138 with Priority: HIGHEST for action port [ 861.608599] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_rules [ 861.609115] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_members [ 861.609115] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e4a089b-da29-4c14-9782-4d787e222138 with Priority: HIGHEST for action port [ 861.609475] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.609664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.609851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.610213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.610347] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.611806] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.612399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.612630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.613677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.613677] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.613677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.613677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.614312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.614312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.614312] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.615880] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e4a089b-da29-4c14-9782-4d787e222138 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.615880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.616108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.616252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.616396] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e4a089b-da29-4c14-9782-4d787e222138',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.118749] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.118749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.119140] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.123026] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e4a089b-da29-4c14-9782-4d787e222138 with status ACTIVE [ 862.123224] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.123501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.123970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.123970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.124241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.124503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.124657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.124704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.125717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.125717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.125717] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.125717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.125717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.125717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.126022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.126022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e4a089b-da29-4c14-9782-4d787e222138 is going to be updated. [ 862.163579] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.163833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.163833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.164195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.164358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.164586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e4a089b-da29-4c14-9782-4d787e222138" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.622393] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.747987] env[66123]: INFO networking_nsxv3.common.synchronization [req-54df56e9-72ba-485b-8f86-c266a789aedf req-d8d3aae4-b604-4b9b-9769-c736e5a64388 tempest-MigrationsAdminTest-723267321 tempest-MigrationsAdminTest-723267321-project-member] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 862.748817] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 862.749198] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.749364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.749557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.749771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.749931] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.750048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.750113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.750703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.750808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.750909] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.812851] env[66123]: INFO networking_nsxv3.common.synchronization [req-9039828b-3e27-4cdb-865c-ae67001a7760 req-442dc6c9-9517-4fdc-9a3f-446562f2d667 tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 862.815020] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGHEST for action security_group_members [ 862.815870] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.816168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.816396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.817047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.817403] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.817970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.818137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.818295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.818503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.818643] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.123929] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.124365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.124365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.124476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.124953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.124953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 is going to be created. [ 863.168816] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.171020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.171020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.171020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.171020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.184811] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 in Status: UNINITIALIZED for 2s [ 863.256341] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.321862] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.322076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.322162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.322428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.322585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.322830] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.322933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.323000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.323202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.323256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.323370] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 is going to be updated. [ 863.357147] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.357332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.357413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.357682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.357926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.370768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: IN_PROGRESS for 2s [ 863.763674] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.266882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.267414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.267414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.267414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.267594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.267594] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be updated. [ 864.331743] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.331951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.332116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.332302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.332459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.351194] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: IN_PROGRESS for 2s [ 865.151815] env[66123]: INFO networking_nsxv3.common.synchronization [req-86cb34e0-15ba-4b78-a989-97aba08cea5e req-e71a8809-e36e-45dc-bae7-a1e9a2eba266 tempest-ServerPasswordTestJSON-568184293 tempest-ServerPasswordTestJSON-568184293-project-member] Enqueued Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_members [ 865.152720] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_members [ 865.152833] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.152964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.153031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.153303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.153466] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.153565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.153629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.153785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.153871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.153962] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.200118] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 in Status: UNINITIALIZED for 4s [ 865.382513] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 in Status: SUCCESS [ 865.382513] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 deletion is rescheduled due to dependency. [ 865.382513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.512094] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.512094] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-286" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.512094] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-286" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.512094] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-286" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.512094] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.512094] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.512710] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.513091] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.513374] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.514195] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.514195] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.514195] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.514195] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.514389] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.515022] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.515022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.545914] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.545914] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.545914] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.545914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-286" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.545914] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-afae3f53-d16a-4a42-b2d9-536cabe77d97 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.545914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.545914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.545914] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.546482] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afae3f53-d16a-4a42-b2d9-536cabe77d97',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.657020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.657256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.657256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.657465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.657568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.657741] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.657845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.657903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.658060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.658130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.658320] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c already deleted. [ 865.658320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.725860] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad6dbc44-9a11-42dc-aaaf-5dcdddd0f8dd req-93a50bd4-86cc-4920-8d4e-1f5b3712f0b5 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 865.726123] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad6dbc44-9a11-42dc-aaaf-5dcdddd0f8dd req-93a50bd4-86cc-4920-8d4e-1f5b3712f0b5 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_members [ 865.726563] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 865.726735] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_members [ 865.727200] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.727362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.727454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.727688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.727879] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.728014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.728088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.728279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.728417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.728570] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.729554] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-79669ebf-e967-46cd-b145-130b45cbbf8d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.730486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.730486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.730486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.730486] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.730486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.730486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.730486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.730486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.730863] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.771051] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad6dbc44-9a11-42dc-aaaf-5dcdddd0f8dd req-93a50bd4-86cc-4920-8d4e-1f5b3712f0b5 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_rules [ 865.771483] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad6dbc44-9a11-42dc-aaaf-5dcdddd0f8dd req-93a50bd4-86cc-4920-8d4e-1f5b3712f0b5 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_members [ 865.771743] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad6dbc44-9a11-42dc-aaaf-5dcdddd0f8dd req-93a50bd4-86cc-4920-8d4e-1f5b3712f0b5 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_rules [ 865.771917] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad6dbc44-9a11-42dc-aaaf-5dcdddd0f8dd req-93a50bd4-86cc-4920-8d4e-1f5b3712f0b5 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 865.772157] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad6dbc44-9a11-42dc-aaaf-5dcdddd0f8dd req-93a50bd4-86cc-4920-8d4e-1f5b3712f0b5 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with Priority: HIGHEST for action port [ 865.773067] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_rules [ 865.773270] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_rules [ 865.773437] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with Priority: HIGHEST for action port [ 865.773592] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_members [ 865.773746] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 865.774195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79669ebf-e967-46cd-b145-130b45cbbf8d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.774340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.774395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.774717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.774817] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.776431] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.777496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.777496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.777496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.777496] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.777761] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-54351622-2e46-4b3d-b5a9-22f40c5a9b50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.777838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.778042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.780145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.780258] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54351622-2e46-4b3d-b5a9-22f40c5a9b50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.781369] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-79669ebf-e967-46cd-b145-130b45cbbf8d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.781494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.781739] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.781833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.048428] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.048812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.049052] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.049471] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.049729] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.049984] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port afae3f53-d16a-4a42-b2d9-536cabe77d97 not found, creating... [ 866.050372] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.050573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.050748] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.051051] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.051200] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.051510] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.051694] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.051837] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.052061] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.052194] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.052422] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: afae3f53-d16a-4a42-b2d9-536cabe77d97 is going to be created. [ 866.073028] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.073268] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.073378] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.073650] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.073879] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.074114] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.233097] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.234232] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.284671] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with status ACTIVE [ 866.284988] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.285192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.285265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.285480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.285572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.285761] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.285865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.285920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.286095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.286175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.286356] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.286448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.286506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.286647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.286719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.286802] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 is going to be updated. [ 866.288162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.288314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.288600] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-79669ebf-e967-46cd-b145-130b45cbbf8d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.288725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.320269] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.320416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.320486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.320731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.320884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.321074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.368383] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: SUCCESS [ 866.368570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.398407] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab1cd2d-726c-461d-a0d1-d9411e52d7cd req-647acbf5-ee08-4dd5-af16-9970171bd319 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 866.398407] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab1cd2d-726c-461d-a0d1-d9411e52d7cd req-647acbf5-ee08-4dd5-af16-9970171bd319 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_members [ 866.398967] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 866.399206] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79669ebf-e967-46cd-b145-130b45cbbf8d with Priority: HIGHEST for action security_group_members [ 866.400064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.400064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.400064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-79669ebf-e967-46cd-b145-130b45cbbf8d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.400278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.477826] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab1cd2d-726c-461d-a0d1-d9411e52d7cd req-647acbf5-ee08-4dd5-af16-9970171bd319 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_rules [ 866.477826] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab1cd2d-726c-461d-a0d1-d9411e52d7cd req-647acbf5-ee08-4dd5-af16-9970171bd319 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 866.478325] env[66123]: INFO networking_nsxv3.common.synchronization [req-0ab1cd2d-726c-461d-a0d1-d9411e52d7cd req-647acbf5-ee08-4dd5-af16-9970171bd319 tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with Priority: HIGHEST for action port [ 866.478970] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_rules [ 866.479141] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 866.479876] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with Priority: HIGHEST for action port [ 866.479876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.479876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.479876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.480203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.480203] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-54351622-2e46-4b3d-b5a9-22f40c5a9b50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.480288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.480856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.480856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.480856] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54351622-2e46-4b3d-b5a9-22f40c5a9b50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.736945] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.738308] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.903201] env[66123]: INFO networking_nsxv3.common.synchronization [req-86cb34e0-15ba-4b78-a989-97aba08cea5e req-502003a3-e503-40e6-8fa9-1aa03ea0a834 service nova] Enqueued Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_rules [ 866.903201] env[66123]: INFO networking_nsxv3.common.synchronization [req-86cb34e0-15ba-4b78-a989-97aba08cea5e req-502003a3-e503-40e6-8fa9-1aa03ea0a834 service nova] Enqueued Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_members [ 866.903201] env[66123]: INFO networking_nsxv3.common.synchronization [req-86cb34e0-15ba-4b78-a989-97aba08cea5e req-502003a3-e503-40e6-8fa9-1aa03ea0a834 service nova] Enqueued Resource ID: afae3f53-d16a-4a42-b2d9-536cabe77d97 with Priority: HIGHEST for action port [ 866.903612] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_rules [ 866.903743] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_members [ 866.903852] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afae3f53-d16a-4a42-b2d9-536cabe77d97 with Priority: HIGHEST for action port [ 866.904344] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.904344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.904555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.904683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.904766] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.905823] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.905989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.906197] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.906292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.906456] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.906548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.906619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.906758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.906843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.906936] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.907856] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-afae3f53-d16a-4a42-b2d9-536cabe77d97 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.907969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.908060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.908217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.908322] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afae3f53-d16a-4a42-b2d9-536cabe77d97',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.986544] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54351622-2e46-4b3d-b5a9-22f40c5a9b50 with status ACTIVE [ 866.986979] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.987153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.987227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.987446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.987535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.987718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.987892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.987957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.988144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.988238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.988430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.988524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.988685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.988842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.989014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.989109] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54351622-2e46-4b3d-b5a9-22f40c5a9b50 is going to be updated. [ 867.015238] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.015440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.015483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.015690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.015834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.015999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54351622-2e46-4b3d-b5a9-22f40c5a9b50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.215936] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 in Status: SUCCESS [ 867.216274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.216438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.216714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.217013] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.217184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.217261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.217453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.217649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.217689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.217787] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.241971] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.242140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.242239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.242491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.242595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.242892] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be updated. [ 867.244868] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.244986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.245074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.245334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.245453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.245453] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79669ebf-e967-46cd-b145-130b45cbbf8d is going to be created. [ 867.279072] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.279241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.279426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.279681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.279827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.287935] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.288201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.288201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.288377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.288520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.308987] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79669ebf-e967-46cd-b145-130b45cbbf8d in Status: UNINITIALIZED for 2s [ 867.309866] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: IN_PROGRESS for 2s [ 867.410132] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.412410] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.413102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.413102] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afae3f53-d16a-4a42-b2d9-536cabe77d97 with status ACTIVE [ 867.413102] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.413102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.413102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.413359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.413481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.413631] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.413746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.413802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.414271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.414271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.414271] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.414543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.414543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.414543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.414640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.414708] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afae3f53-d16a-4a42-b2d9-536cabe77d97 is going to be updated. [ 867.442681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.442853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.442928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.443221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.443379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.443560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afae3f53-d16a-4a42-b2d9-536cabe77d97" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.721698] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.722338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.723300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.723446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.723637] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.723766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.723834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.723963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.724068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.724199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.724387] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.724503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.724571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.724774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.724969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.725088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.725185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.725292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.725372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.725454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.725543] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.913593] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.230757] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3fdb4db-b3f4-4212-be18-d27312664ed6: rpc.has_security_group_logging(os_id): False [ 868.254683] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.254683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.254683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.254972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.256141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.256141] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.256141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.256141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.256141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.256141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.256510] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.256563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.256806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.256806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.257120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.257454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.258518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.258518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.258518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.258518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.258518] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 is going to be created. [ 868.354888] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.355085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.355085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.355371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.355608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.378162] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 in Status: IN_PROGRESS for 2s [ 868.415859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.416405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.416405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.416405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.416405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.416780] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c is going to be created. [ 868.459023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.459023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.459023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.459023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.459023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.471342] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c in Status: UNINITIALIZED for 2s [ 869.332107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79669ebf-e967-46cd-b145-130b45cbbf8d in Status: SUCCESS [ 869.332107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.332107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 869.332107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.332107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.332107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.332107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.332107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.332107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.332578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.332578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.332578] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.333407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.333611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.333874] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.333991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.334059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.335389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.335389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.335389] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.836935] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.839062] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.839062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.839062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.839062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.839062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.839343] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.839343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.839343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.839585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.839700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.839848] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79669ebf-e967-46cd-b145-130b45cbbf8d is going to be deleted. [ 869.881127] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.881972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.881972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.881972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.881972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.881972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.881972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.883050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.883050] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.883050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.883050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.883050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.883050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.883363] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.129665] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8b113f1-e06e-4c76-a76a-fb3198072910 req-7927c0ca-1246-4d30-bc45-a9146405bf11 tempest-ServersWithSpecificFlavorTestJSON-678692171 tempest-ServersWithSpecificFlavorTestJSON-678692171-project-member] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 870.130628] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 870.130628] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.130848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.130848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.131040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.131203] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.131675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.131771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.131936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.132062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.132218] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.346932] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.390317] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.390658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.390658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.390980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.391145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.391685] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.391866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.391866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.392111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.392222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.392560] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79669ebf-e967-46cd-b145-130b45cbbf8d already deleted. [ 870.392560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.392661] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.395576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.395576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.395576] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.395576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.395576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.395576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.395576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.395576] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.398434] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 in Status: SUCCESS [ 870.398532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.484375] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c in Status: SUCCESS [ 870.484375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.485303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.485552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.485837] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.485947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.485947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.486127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.486249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.486314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.486390] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.519730] env[66123]: INFO networking_nsxv3.common.synchronization [req-a91ca5e2-0446-4fce-b892-10c47af7d51d req-1a5033af-db66-486d-9a73-c9a7063a3cb3 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 870.521704] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 870.521704] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.521704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.521704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.522018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.522018] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.522123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.522401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.522401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.522545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.522593] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.601974] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-879 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.602372] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.602372] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.602492] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.602785] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.602983] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.603182] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.603426] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.603605] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.603953] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.603953] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.604128] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.604216] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.604339] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.604463] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.604701] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.627920] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.628181] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.628408] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.628565] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-879" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.628932] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-abe75e53-35b1-4554-9a03-2bafffa0c97e taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.629174] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.629366] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.629875] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.630190] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abe75e53-35b1-4554-9a03-2bafffa0c97e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.635673] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.635849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.635915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.636199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.636372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.636606] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.636721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.636819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.637027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.637115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.637208] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be updated. [ 870.670016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.670016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.670271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.670532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.670532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.684203] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: IN_PROGRESS for 2s [ 870.851884] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.852426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.852426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.852426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.852635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.852635] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be updated. [ 870.892769] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.893043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.893130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.893401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.893597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.897035] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79669ebf-e967-46cd-b145-130b45cbbf8d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.902247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.902440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.902440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.902618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.902703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.902928] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.903121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.903121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.903295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.903400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.903491] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79669ebf-e967-46cd-b145-130b45cbbf8d already deleted. [ 870.903590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.907069] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: IN_PROGRESS for 2s [ 870.989703] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.989996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.990168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.990494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.990798] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.990975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.991189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.991404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.991575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.991764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.991980] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.992247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.992352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.992543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.992705] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.992827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.992900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.993092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.993189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.993281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.993396] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.025263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.025492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.025556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.025757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.025819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.026033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.026145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.026193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.026467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.026551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.026641] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 871.058262] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.058456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.058508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.058775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.058939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.069070] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 871.132743] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.133032] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.133133] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.133785] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.133785] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.133785] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port abe75e53-35b1-4554-9a03-2bafffa0c97e not found, creating... [ 871.134367] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.134367] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.134367] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.134741] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.134813] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.135117] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.135273] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.135401] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.135624] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.135770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.135911] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: abe75e53-35b1-4554-9a03-2bafffa0c97e is going to be created. [ 871.166764] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.167062] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.167823] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.167823] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.168049] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.168236] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.400714] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79669ebf-e967-46cd-b145-130b45cbbf8d: rpc.has_security_group_logging(os_id): False [ 871.421831] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.422036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.422141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.422444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.422566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.422841] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.422960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.423176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.423289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.423410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.423549] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79669ebf-e967-46cd-b145-130b45cbbf8d is going to be created. [ 871.443859] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/79669ebf-e967-46cd-b145-130b45cbbf8d], does not exist path=[/infra/domains/default/groups/79669ebf-e967-46cd-b145-130b45cbbf8d]."\n}' [ 871.444119] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79669ebf-e967-46cd-b145-130b45cbbf8d failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/79669ebf-e967-46cd-b145-130b45cbbf8d [ 871.444393] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 871.491579] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.491579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.491579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.491863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.493642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.493642] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.493642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.493642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.493642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.493642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.493642] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.494323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.494323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.494323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.494323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.494323] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79669ebf-e967-46cd-b145-130b45cbbf8d is going to be created. [ 871.495460] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fc16eb3-c511-42d0-ac83-eeb07f37616c: rpc.has_security_group_logging(os_id): False [ 871.514924] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.515093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.515142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.515385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.515491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.515685] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.515868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.515868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.515980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.516059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.516276] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.516362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.516420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.516613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.516688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.516883] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.516972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.517042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.517209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.517258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.517314] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c is going to be created. [ 871.520542] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/79669ebf-e967-46cd-b145-130b45cbbf8d], does not exist path=[/infra/domains/default/groups/79669ebf-e967-46cd-b145-130b45cbbf8d]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/79669ebf-e967-46cd-b145-130b45cbbf8d [ 871.520711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79669ebf-e967-46cd-b145-130b45cbbf8d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.521267] env[66123]: Traceback (most recent call last): [ 871.521311] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 871.521311] env[66123]: return func(*args, **kwargs) [ 871.521311] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 871.521311] env[66123]: res.raise_for_status() [ 871.521311] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 871.521311] env[66123]: raise HTTPError(http_error_msg, response=self) [ 871.521311] env[66123]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/79669ebf-e967-46cd-b145-130b45cbbf8d [ 871.521311] env[66123]: During handling of the above exception, another exception occurred: [ 871.521311] env[66123]: Traceback (most recent call last): [ 871.521311] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 871.521311] env[66123]: listener.cb(fileno) [ 871.521661] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 871.521661] env[66123]: result = function(*args, **kwargs) [ 871.521661] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 871.521661] env[66123]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 871.521661] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 871.521661] env[66123]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 871.521661] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 871.521661] env[66123]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 871.521661] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 871.521661] env[66123]: res.raise_for_status() [ 871.521661] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 871.521661] env[66123]: raise HTTPError(http_error_msg, response=self) [ 871.521661] env[66123]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/79669ebf-e967-46cd-b145-130b45cbbf8d [ 871.521661] env[66123]: Removing descriptor: 59 [ 871.582100] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.582349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.582398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.583894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.583894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.598122] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c in Status: IN_PROGRESS for 2s [ 871.921714] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8b113f1-e06e-4c76-a76a-fb3198072910 req-e9c128ca-15e1-4866-b666-0f05e6700ae5 service nova] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 871.921998] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8b113f1-e06e-4c76-a76a-fb3198072910 req-e9c128ca-15e1-4866-b666-0f05e6700ae5 service nova] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 871.922052] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8b113f1-e06e-4c76-a76a-fb3198072910 req-e9c128ca-15e1-4866-b666-0f05e6700ae5 service nova] Enqueued Resource ID: abe75e53-35b1-4554-9a03-2bafffa0c97e with Priority: HIGHEST for action port [ 871.922625] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_rules [ 871.922758] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 871.922854] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abe75e53-35b1-4554-9a03-2bafffa0c97e with Priority: HIGHEST for action port [ 871.923512] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.923607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.923689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.924149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.924149] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.926013] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.926013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.926013] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-abe75e53-35b1-4554-9a03-2bafffa0c97e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.926013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.926013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.929383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.929496] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abe75e53-35b1-4554-9a03-2bafffa0c97e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.426571] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.426714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.434638] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abe75e53-35b1-4554-9a03-2bafffa0c97e with status ACTIVE [ 872.434638] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.434638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.434638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.434638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.434638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.434638] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.434638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.434638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.435538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.435538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.437305] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.437305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.437305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.437305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.437305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.437305] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abe75e53-35b1-4554-9a03-2bafffa0c97e is going to be updated. [ 872.460301] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.461995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.461995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.461995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.461995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.461995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abe75e53-35b1-4554-9a03-2bafffa0c97e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.695257] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 872.695462] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc deletion is rescheduled due to dependency. [ 872.695593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.695767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.695987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.696210] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.696327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.696392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.696554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.696629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.696726] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.921075] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 872.921075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.921075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.921333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.921683] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.921778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.922060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.922060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.922155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.922460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.922460] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.923405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.923602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.923790] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.923904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.923984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.924274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.924379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.924584] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.080308] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 873.080557] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 873.080693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.199509] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.427120] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.427357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.428038] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.611447] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c in Status: SUCCESS [ 873.611643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.702059] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.931836] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.205527] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.206406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.206406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.206680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.206730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.206832] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be updated. [ 874.237894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.238111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.238202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.238497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.238662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.251489] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: IN_PROGRESS for 2s [ 874.435678] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.435678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.435678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.436103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.436184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.436366] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be updated. [ 874.493421] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.493567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.493666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.493921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.494084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.505375] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: IN_PROGRESS for 2s [ 875.311286] env[66123]: INFO networking_nsxv3.common.synchronization [req-79c332a2-49ef-469e-a8e4-b2f414b44b4b req-64ce9a2c-ec78-4621-a43c-42253ee12a4f tempest-ServerRescueTestJSONUnderV235-1813413122 tempest-ServerRescueTestJSONUnderV235-1813413122-project-member] Enqueued Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 875.312749] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90668e0f-9991-480a-b163-29326b17781d with Priority: HIGHEST for action security_group_members [ 875.312749] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.312749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.266915] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 876.267147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.267323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.267552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.267748] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.267869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.267933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.268225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.268225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.268355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.268803] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.520735] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 876.520735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.520735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.520735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.520735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.520735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.520735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.520735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.520735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.520735] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.771552] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.023193] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.023425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.023425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.023600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.046808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.047335] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.047335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.047335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.047603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.047640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.047750] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be updated. [ 877.081093] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.081327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.081409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.081628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.081843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.093586] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: IN_PROGRESS for 2s [ 877.274295] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3af04420-6b85-4613-8554-92a0065c78dc: rpc.has_security_group_logging(os_id): False [ 877.296280] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.296466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.296510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.297091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.329020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.329362] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.329527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.329603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.329844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.329978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.330109] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be updated. [ 877.433842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.435089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.435089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.435089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.435089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.452672] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: IN_PROGRESS for 2s [ 878.542450] env[66123]: INFO networking_nsxv3.common.synchronization [req-1b1f2c1c-34f1-45c4-8c6d-4c9c1d6ee126 req-25f316d8-1d91-4a5a-99e1-da3f299a4012 tempest-ServerPasswordTestJSON-568184293 tempest-ServerPasswordTestJSON-568184293-project-member] Enqueued Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_members [ 878.543932] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGHEST for action security_group_members [ 878.543932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.543932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.543932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.543932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.544315] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.544315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.544315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.544468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.544468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.544534] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.047788] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.047956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.048056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.048323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.048593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.048789] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.048898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.048963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.049141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.049287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.049329] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c is going to be updated. [ 879.078404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.078404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.078603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.078691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.078814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.089875] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c in Status: IN_PROGRESS for 2s [ 879.102518] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 879.102673] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d deletion is rescheduled due to dependency. [ 879.102788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.102952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.103189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.103391] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.103509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.103570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.103721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.103802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.103887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.104055] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-90668e0f-9991-480a-b163-29326b17781d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.104131] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.104183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.104349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.104485] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.104575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.104631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.104768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.104839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.104942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.105040] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.106031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.106137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.106262] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.106361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.106424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.106592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.106651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.106799] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.469582] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 879.469899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.608970] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90668e0f-9991-480a-b163-29326b17781d: rpc.has_security_group_logging(os_id): False [ 879.613993] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.613993] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.613993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.613993] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be updated. [ 879.633023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.633023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.633023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.633023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.633785] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.633785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.633785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.633785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.633785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.633785] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be updated. [ 879.642780] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.642780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.642780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.643191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.643191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.652619] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: IN_PROGRESS for 2s [ 879.710979] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.711179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.711224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.711471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.711590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.729676] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: IN_PROGRESS for 2s [ 880.225379] env[66123]: INFO networking_nsxv3.common.synchronization [req-5479b439-743a-4f7e-b596-7b4c8d595630 req-0f434ef0-5859-4f79-bebe-16bc1dbafdc1 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 880.225490] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 880.228693] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.228800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.229092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.229256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.229477] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.229573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.229618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.229949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.229949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.230135] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.627223] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.627533] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.627785] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.628657] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.628657] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.629847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.629847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.629847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.629847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.629847] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.629847] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.630789] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.630789] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.630789] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.630789] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.630789] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.653822] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.690016] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.690016] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.690016] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.690016] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-e77a69fe-51fa-4b90-86bd-7053985f95e5 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.690016] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.690016] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.690016] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.690016] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77a69fe-51fa-4b90-86bd-7053985f95e5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.733601] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.733882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.733964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.734306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.734447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.734840] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.734840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.735067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.735181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.735284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.735383] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 already deleted. [ 880.735486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.103208] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c in Status: SUCCESS [ 881.103501] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c deletion is rescheduled due to dependency. [ 881.103617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.158432] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.158639] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.158809] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.159083] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.159396] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.159579] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port e77a69fe-51fa-4b90-86bd-7053985f95e5 not found, creating... [ 881.159997] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.160229] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.160408] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.160726] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.160903] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.161268] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.161434] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.161759] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.162184] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.162413] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.162663] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: e77a69fe-51fa-4b90-86bd-7053985f95e5 is going to be created. [ 881.186053] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.186313] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.186481] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.186915] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.187097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.187357] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.440404] env[66123]: INFO networking_nsxv3.common.synchronization [req-f18ab50e-5acb-438d-88a7-0876f5d29325 req-68081899-31de-46fe-aed6-a176436df0a3 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 881.441761] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 881.441761] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.441761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.441761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.441761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.442057] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.442057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.442057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.442410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.442502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.442600] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.664472] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 881.664878] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90668e0f-9991-480a-b163-29326b17781d deletion is rescheduled due to dependency. [ 881.664878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.746728] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90668e0f-9991-480a-b163-29326b17781d in Status: SUCCESS [ 881.746982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.747279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.747612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.747722] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90668e0f-9991-480a-b163-29326b17781d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.920041] env[66123]: INFO networking_nsxv3.common.synchronization [req-5479b439-743a-4f7e-b596-7b4c8d595630 req-7882eb32-aff5-4cec-b43c-e948a28615b5 service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 881.920041] env[66123]: INFO networking_nsxv3.common.synchronization [req-5479b439-743a-4f7e-b596-7b4c8d595630 req-7882eb32-aff5-4cec-b43c-e948a28615b5 service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 881.920041] env[66123]: INFO networking_nsxv3.common.synchronization [req-5479b439-743a-4f7e-b596-7b4c8d595630 req-7882eb32-aff5-4cec-b43c-e948a28615b5 service nova] Enqueued Resource ID: e77a69fe-51fa-4b90-86bd-7053985f95e5 with Priority: HIGHEST for action port [ 881.920507] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 881.920640] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 881.920740] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e77a69fe-51fa-4b90-86bd-7053985f95e5 with Priority: HIGHEST for action port [ 881.921054] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.921177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.921252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.921554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.921654] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.922582] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.922713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.922781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.923129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.923296] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.923399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.923462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.923636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.923748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.923847] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.924966] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e77a69fe-51fa-4b90-86bd-7053985f95e5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.926490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.926663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.926841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.926967] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77a69fe-51fa-4b90-86bd-7053985f95e5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.944463] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.944606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.944606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.944802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.967427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.967704] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.967822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.967897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.968105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.968190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.968280] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be updated. [ 881.999627] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.999860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.999860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.000039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.000183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.012041] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: IN_PROGRESS for 2s [ 882.285391] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.285596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.285671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.285904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.285996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.286117] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90668e0f-9991-480a-b163-29326b17781d is going to be deleted. [ 882.370835] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.371069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.371153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.371413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.371539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.371690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90668e0f-9991-480a-b163-29326b17781d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.429277] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.430478] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.430616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.430995] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e77a69fe-51fa-4b90-86bd-7053985f95e5 with status ACTIVE [ 882.431183] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.431310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.431380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.431586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.431673] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.431842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.431946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.432997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.433236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.433630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.433630] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.433630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.433819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.433866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.433925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.434046] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e77a69fe-51fa-4b90-86bd-7053985f95e5 is going to be updated. [ 882.469987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.470205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.470331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.470618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.470796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.471056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e77a69fe-51fa-4b90-86bd-7053985f95e5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.932525] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.058161] env[66123]: INFO networking_nsxv3.common.synchronization [req-13700789-59cc-46af-ac49-69af63a35203 req-8402bc88-9e5f-4ed3-b50f-fa5d65971699 tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 883.060890] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 883.061422] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.061773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.061773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.062127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.062454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.062640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.062741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.062999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.063145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.063326] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.427457] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-264 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.427633] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.427740] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.428048] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.428270] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.428444] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.428568] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.428804] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.428946] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.429161] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.429274] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.429376] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.429481] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.429613] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.429713] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.429840] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.435486] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.435693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.435754] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.435919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.436019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.436120] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be created. [ 883.452169] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.452254] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.452603] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.452890] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-264" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.453236] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-8bec90f8-7bb6-406d-acb1-78e440836d05 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.453489] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.453690] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.454126] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.454351] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bec90f8-7bb6-406d-acb1-78e440836d05',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.467037] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.467037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.467037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.467037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.467037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.483625] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: UNINITIALIZED for 2s [ 883.566542] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.566845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.566976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.567137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.567238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.567626] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.567728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.567760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.568264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.568264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.568493] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be deleted. [ 883.607352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.607560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.607711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.607996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.608195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.608382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.958474] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.958474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.958474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.958889] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.958889] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.958999] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 8bec90f8-7bb6-406d-acb1-78e440836d05 not found, creating... [ 883.961207] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.961207] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.961207] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.961207] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.961207] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.965691] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.965691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.965691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.965691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.965691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.965691] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 8bec90f8-7bb6-406d-acb1-78e440836d05 is going to be created. [ 883.989061] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.989322] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.989469] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.989866] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.990142] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.990513] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.015306] env[66123]: INFO networking_nsxv3.common.synchronization [None req-5dd011ae-ac19-432b-85ab-7a4f8c333b6a tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_rules [ 884.016029] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_rules [ 884.017088] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.017088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.017088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.017457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.017525] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.030142] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: SUCCESS [ 884.030806] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 deletion is rescheduled due to dependency. [ 884.030806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.142616] env[66123]: INFO networking_nsxv3.common.synchronization [None req-55b3d614-2aaf-4884-b556-75d518725e97 tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_rules [ 884.142616] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_rules [ 884.142616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.142616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.539088] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.539320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.539463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.539765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.540083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.540302] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 already deleted. [ 884.540463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.540697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.540987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.541053] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.688548] env[66123]: INFO networking_nsxv3.common.synchronization [req-13700789-59cc-46af-ac49-69af63a35203 req-44ee5265-1c76-4b36-ab1b-05ffa38c6268 service nova] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_rules [ 884.688548] env[66123]: INFO networking_nsxv3.common.synchronization [req-13700789-59cc-46af-ac49-69af63a35203 req-44ee5265-1c76-4b36-ab1b-05ffa38c6268 service nova] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 884.688682] env[66123]: INFO networking_nsxv3.common.synchronization [req-13700789-59cc-46af-ac49-69af63a35203 req-44ee5265-1c76-4b36-ab1b-05ffa38c6268 service nova] Enqueued Resource ID: 8bec90f8-7bb6-406d-acb1-78e440836d05 with Priority: HIGHEST for action port [ 884.689207] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_rules [ 884.689341] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 884.689439] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec90f8-7bb6-406d-acb1-78e440836d05 with Priority: HIGHEST for action port [ 884.689722] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.689839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.689898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.692711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.692830] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.694122] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.694247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.694334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.694529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.694721] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.694797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.694840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.694996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.695225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.695225] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.696015] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bec90f8-7bb6-406d-acb1-78e440836d05 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.697376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.697376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.697376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.697376] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bec90f8-7bb6-406d-acb1-78e440836d05',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.065404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.065740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.065782] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.066072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.066166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.066270] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 already deleted. [ 885.066354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.198874] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.199952] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.200082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.200256] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bec90f8-7bb6-406d-acb1-78e440836d05 with status ACTIVE [ 885.200421] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.200531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.200597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.200798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.201071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.201071] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.201190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.201218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.202595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.202595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.202595] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.202595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.202595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.203047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.203047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.203047] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bec90f8-7bb6-406d-acb1-78e440836d05 is going to be updated. [ 885.225173] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.225368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.225426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.225764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.225923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.226144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bec90f8-7bb6-406d-acb1-78e440836d05" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.495698] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 885.495921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.496571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.496852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.497062] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.497749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.497749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.497749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.497749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.497749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.497749] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.651055] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-b58c7c3d-b59f-4f66-8c4b-19b0ccb4f1ea tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 885.651444] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 885.652848] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.653544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.653647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.653882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.654299] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.654299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.654299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.654814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.654982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.655152] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.705355] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.000446] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.000654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.000746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.000993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.001189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.002303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.002303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.002303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.002303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.002303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.002303] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.002303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.002303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.002805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.002805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.002805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.002805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.003022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.003022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.003109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.003231] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.160750] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.160750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.160750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.160750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.184196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.184680] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.184866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.184974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.185446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.185708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.185897] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 886.208494] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.208575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.208615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.208952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.209143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.209266] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be created. [ 886.220494] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.220494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.220494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.220785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.221017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.225308] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.225675] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.225865] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.226245] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.226527] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.226687] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.226815] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.227027] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.227264] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.227578] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.227739] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.227949] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.228079] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.228285] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.228475] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.229356] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.232600] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 886.240458] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.240664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.240722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.240960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.241220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.258653] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: UNINITIALIZED for 2s [ 886.268754] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.268992] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.269213] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.269446] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.269866] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-4772fa2d-cae9-4550-bac2-6bb5cad66376 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.270097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.270251] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.270656] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.270814] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4772fa2d-cae9-4550-bac2-6bb5cad66376',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.505599] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9172499c-e925-4db8-91df-db6b7bc0f5c2: rpc.has_security_group_logging(os_id): False [ 886.531058] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.531263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.531263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.531433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.531581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.531802] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.531914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.536440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.537119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.537223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.537556] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.537697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.537792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.538068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.538166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.538463] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.538615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.542112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.542572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.542669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.542831] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be created. [ 886.617178] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.617385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.617515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.617790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.618053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.635070] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 886.774179] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.774613] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.774723] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.775118] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.775328] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.775550] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 4772fa2d-cae9-4550-bac2-6bb5cad66376 not found, creating... [ 886.775926] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.776167] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.777077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.777077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.777077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.777268] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.777452] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.777615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.777927] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.778111] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.778382] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 4772fa2d-cae9-4550-bac2-6bb5cad66376 is going to be created. [ 886.803658] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.804066] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.804594] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.805013] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.805280] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.805597] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.529574] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-21419745-226d-406a-be7a-29960bc68703 service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 887.530135] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-21419745-226d-406a-be7a-29960bc68703 service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 887.530372] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-21419745-226d-406a-be7a-29960bc68703 service nova] Enqueued Resource ID: 4772fa2d-cae9-4550-bac2-6bb5cad66376 with Priority: HIGHEST for action port [ 887.531018] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 887.531255] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 887.531443] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4772fa2d-cae9-4550-bac2-6bb5cad66376 with Priority: HIGHEST for action port [ 887.531797] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.532501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.532501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.532501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.532501] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.533932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.534042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.534200] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-4772fa2d-cae9-4550-bac2-6bb5cad66376 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.534343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.534392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.534574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.534669] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4772fa2d-cae9-4550-bac2-6bb5cad66376',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.794337] env[66123]: INFO networking_nsxv3.common.synchronization [req-6a399926-c5b4-47bb-b2f9-8c7ec5abbcfe req-22244682-2b0f-49ec-bdd3-3ea34a34b5ed tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 887.794928] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 887.795250] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.795385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.795455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.795670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.795821] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.795921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.795970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.796168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.796254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.796348] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.034752] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.035086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.040469] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4772fa2d-cae9-4550-bac2-6bb5cad66376 with status ACTIVE [ 888.040716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.040896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.040998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.041322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.041420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.041681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.041801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.042822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.042822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.042822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.042822] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.042822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.042822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.043379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.043379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.043379] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4772fa2d-cae9-4550-bac2-6bb5cad66376 is going to be updated. [ 888.086709] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.086895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.086929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.087254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.087441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.087711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4772fa2d-cae9-4550-bac2-6bb5cad66376" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.256719] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 888.256719] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 deletion is rescheduled due to dependency. [ 888.256906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.257470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.257470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.257470] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.257656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.257656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.257912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.257912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.257990] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.270581] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 888.270701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.270840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.272774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.272774] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.272774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.272774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.272774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.272774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.272774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.272774] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.298916] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.362691] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-4a739483-f4bb-4f1f-9c07-afdcc91b1553 tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 888.364670] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 888.364958] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.365091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.654788] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 888.654788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.758784] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.758784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.759021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.763303] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.763766] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.764025] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.764156] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.764529] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.764708] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.764929] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.765058] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.765172] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.765315] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.765476] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.765591] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.765731] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.768581] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.779032] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.779193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.779266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.779477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.779646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.780333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.780333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.780333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.780731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.780955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.781382] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.781382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.781487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.781674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.781863] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.782142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.782142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.782363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.782363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.783072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.783072] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.791952] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.792141] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.792288] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.792445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-457" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.792769] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.793018] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.793156] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.793476] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.793615] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c5b291-5eb5-4b77-bb92-9d45ba0b948f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.800453] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.271363] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.285663] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69e73b71-1b94-4c07-a51a-893782ee1e09: rpc.has_security_group_logging(os_id): False [ 889.297425] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.297653] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.297778] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.298083] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.298234] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.298410] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 16c5b291-5eb5-4b77-bb92-9d45ba0b948f not found, creating... [ 889.298694] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.298854] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.298970] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.299208] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.299345] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.299627] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.299978] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.299978] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.300124] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.300258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.300394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 16c5b291-5eb5-4b77-bb92-9d45ba0b948f is going to be created. [ 889.301976] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.302101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.302167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.302364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.302435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.302550] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 889.312694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.312846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.312895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.313254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.313362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.313598] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.313703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.313764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.314862] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.314862] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.314862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.315273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.315273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.315273] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be created. [ 889.331520] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.331520] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.331767] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.331957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.332374] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.332771] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.340174] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.340350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.340421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.340638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.341348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.352596] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 889.406527] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.407219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.407219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.407584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.407816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.426058] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 889.776934] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.776934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.776934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.776934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.776934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.776934] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 889.812275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.812275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.812275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.812275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.812275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.825265] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 890.088687] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-f4ce704c-f614-47de-8627-40fe327219c5 service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 890.088687] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-f4ce704c-f614-47de-8627-40fe327219c5 service nova] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 890.089061] env[66123]: INFO networking_nsxv3.common.synchronization [req-b585a151-6e86-4610-b021-d25c807e32da req-f4ce704c-f614-47de-8627-40fe327219c5 service nova] Enqueued Resource ID: 16c5b291-5eb5-4b77-bb92-9d45ba0b948f with Priority: HIGHEST for action port [ 890.089584] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_rules [ 890.089723] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 890.089828] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c5b291-5eb5-4b77-bb92-9d45ba0b948f with Priority: HIGHEST for action port [ 890.090148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.090251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.090459] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.090576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.090773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.090874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.090982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.091777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.091777] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c5b291-5eb5-4b77-bb92-9d45ba0b948f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.593547] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16c5b291-5eb5-4b77-bb92-9d45ba0b948f with status ACTIVE [ 890.593832] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.593972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.594062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.594281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.594393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.594582] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.594685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.594744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.594905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.594989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.595181] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.595291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.595342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.595462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.595527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.595643] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16c5b291-5eb5-4b77-bb92-9d45ba0b948f is going to be updated. [ 890.619097] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.619198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.619243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.620415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.620415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.620415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16c5b291-5eb5-4b77-bb92-9d45ba0b948f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.158680] env[66123]: INFO networking_nsxv3.common.synchronization [req-7d843a03-e232-421c-8b6b-3ecff4ebebe8 req-99b03c61-fdea-460a-bc80-1c2fc4ebbefd tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 891.159182] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 891.159486] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.159608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.159676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.159870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.160343] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.162784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.163050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.163678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.163835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.163980] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.367558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 891.367558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.442284] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 891.445093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.669579] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.669579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.669579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.669579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.688393] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.688393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.688393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.688393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.688393] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.688393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.688393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.688943] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.689575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.689930] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.690171] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.690370] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.690564] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.690760] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.690972] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.691207] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.696170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.696170] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.696170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.696170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.696170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.696425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.696425] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 891.729864] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.730065] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.731368] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.731506] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.731823] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-acc314fc-71fc-4a17-8524-f243189800b3 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.732481] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.732703] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.733128] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.733306] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc314fc-71fc-4a17-8524-f243189800b3',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.736400] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.736400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.736636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.736636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.736816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.748678] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 891.839487] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.839487] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.839487] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.839487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.840225] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.840460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.840608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.840833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.841011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.841187] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.236732] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.237090] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.237160] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.237397] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.237857] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.237857] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port acc314fc-71fc-4a17-8524-f243189800b3 not found, creating... [ 892.237989] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.238146] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.238271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.238498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.238634] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.238933] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.239175] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.239315] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.239507] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.239644] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.239783] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: acc314fc-71fc-4a17-8524-f243189800b3 is going to be created. [ 892.265718] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.265856] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.265889] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.266232] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.266519] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.267265] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.343763] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.343915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.345312] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.847401] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.351859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.352317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.352317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.352429] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 893.383903] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.384190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.384292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.384536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.384654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.395941] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 893.547183] env[66123]: INFO networking_nsxv3.common.synchronization [req-7d843a03-e232-421c-8b6b-3ecff4ebebe8 req-f577c775-14cb-471f-8e50-6625726ab4d8 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 893.547377] env[66123]: INFO networking_nsxv3.common.synchronization [req-7d843a03-e232-421c-8b6b-3ecff4ebebe8 req-f577c775-14cb-471f-8e50-6625726ab4d8 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 893.547520] env[66123]: INFO networking_nsxv3.common.synchronization [req-7d843a03-e232-421c-8b6b-3ecff4ebebe8 req-f577c775-14cb-471f-8e50-6625726ab4d8 service nova] Enqueued Resource ID: acc314fc-71fc-4a17-8524-f243189800b3 with Priority: HIGHEST for action port [ 893.548134] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 893.548275] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 893.548372] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acc314fc-71fc-4a17-8524-f243189800b3 with Priority: HIGHEST for action port [ 893.548647] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.548761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.549020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.549020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.549127] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.552187] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.552187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.552187] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-acc314fc-71fc-4a17-8524-f243189800b3 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.552187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.552187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.552187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.552187] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc314fc-71fc-4a17-8524-f243189800b3',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.762893] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 893.763198] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 deletion is rescheduled due to dependency. [ 893.763334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.763675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.763749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.763979] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.764124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.764124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.764309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.764460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.764563] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.057190] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057190] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fefa76b-3a03-4cb0-a4c8-48c8ccf3840d req-a5c4b462-7bd8-4c4a-92b3-a15b755a4bba tempest-ImagesNegativeTestJSON-1347675059 tempest-ImagesNegativeTestJSON-1347675059-project-member] Enqueued Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_members [ 894.057190] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acc314fc-71fc-4a17-8524-f243189800b3 with status ACTIVE [ 894.057190] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.058308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.058355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.058634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.058756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.059019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.059145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.059237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.059452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.059545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.059812] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.059883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.059932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.060096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.060171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.060253] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acc314fc-71fc-4a17-8524-f243189800b3 is going to be updated. [ 894.062449] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_members [ 894.062966] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-861f81b8-db22-4a30-a43a-194caa55e446 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.064032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.064032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.064032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.064032] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.064032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.064032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.064032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.064313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.064494] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.089892] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.089892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.089892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.089892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.089892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.089892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acc314fc-71fc-4a17-8524-f243189800b3" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.268679] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.567497] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.567497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.567899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.567935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.568104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.568388] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.568536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.568635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.568859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.568976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.569107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 861f81b8-db22-4a30-a43a-194caa55e446 already deleted. [ 894.569232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.637397] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.637624] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-95" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.637750] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-95" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.638102] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-95" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.638592] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.638769] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.638903] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.639144] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.639313] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.639657] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.639822] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.639937] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.640072] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.640197] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.640392] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.640548] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.659684] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.659857] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 894.662250] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.662250] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-95" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.662250] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-b0a1aa80-87fe-4597-8cec-26995140600d taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.662250] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.662250] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.662250] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.662250] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a1aa80-87fe-4597-8cec-26995140600d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.770244] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.164977] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.165148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.165276] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.165632] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.165783] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.165962] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port b0a1aa80-87fe-4597-8cec-26995140600d not found, creating... [ 895.166245] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.166778] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.166778] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.166778] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.166946] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.167136] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.167288] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.167399] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.167607] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.167810] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.167865] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: b0a1aa80-87fe-4597-8cec-26995140600d is going to be created. [ 895.193077] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.193077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.193077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.193311] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.193836] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.193836] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.272352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.272612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.272612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.272822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.272918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.273029] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 895.324129] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.324304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.324346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.324641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.324792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.350665] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 895.368268] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7e275ce9-7819-43fb-bbd3-db447d6fe2e3 None None] Enqueued Resource ID: 8f6b8525-fe41-404c-a1b7-8a2b7c7c0307 with Priority: HIGHEST for action port [ 895.368598] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f6b8525-fe41-404c-a1b7-8a2b7c7c0307 with Priority: HIGHEST for action port [ 895.369065] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f6b8525-fe41-404c-a1b7-8a2b7c7c0307 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.369065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f6b8525-fe41-404c-a1b7-8a2b7c7c0307" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.369065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f6b8525-fe41-404c-a1b7-8a2b7c7c0307" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.369584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f6b8525-fe41-404c-a1b7-8a2b7c7c0307" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.369584] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f6b8525-fe41-404c-a1b7-8a2b7c7c0307',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.408768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 895.409192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.409579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.409963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.410251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.410426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.410540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.410782] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.410901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.411243] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.871933] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f6b8525-fe41-404c-a1b7-8a2b7c7c0307 [ 895.872229] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.872396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.872501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.872861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.873013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.873173] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f6b8525-fe41-404c-a1b7-8a2b7c7c0307 already deleted. [ 895.873365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f6b8525-fe41-404c-a1b7-8a2b7c7c0307" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.913528] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.003443] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fefa76b-3a03-4cb0-a4c8-48c8ccf3840d req-56c854c6-be46-4b2e-8f77-9f5b93813258 service nova] Enqueued Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_rules [ 896.003443] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fefa76b-3a03-4cb0-a4c8-48c8ccf3840d req-56c854c6-be46-4b2e-8f77-9f5b93813258 service nova] Enqueued Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_members [ 896.003443] env[66123]: INFO networking_nsxv3.common.synchronization [req-8fefa76b-3a03-4cb0-a4c8-48c8ccf3840d req-56c854c6-be46-4b2e-8f77-9f5b93813258 service nova] Enqueued Resource ID: b0a1aa80-87fe-4597-8cec-26995140600d with Priority: HIGHEST for action port [ 896.003443] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_rules [ 896.003711] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_members [ 896.006711] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a1aa80-87fe-4597-8cec-26995140600d with Priority: HIGHEST for action port [ 896.008220] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-861f81b8-db22-4a30-a43a-194caa55e446 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.008369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.008442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.008719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.008806] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.012159] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-861f81b8-db22-4a30-a43a-194caa55e446 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.012159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.012159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.012159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.012159] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.012159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.012159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.013496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.013586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.013697] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.016950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0a1aa80-87fe-4597-8cec-26995140600d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.017124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.017200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.017347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.017428] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a1aa80-87fe-4597-8cec-26995140600d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.416499] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.518096] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.519540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-861f81b8-db22-4a30-a43a-194caa55e446 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.519540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.520771] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0a1aa80-87fe-4597-8cec-26995140600d with status ACTIVE [ 896.520995] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.521342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.521425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.521629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.521722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.521894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.522030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.522059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.522221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.522316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.522504] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.522600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.522662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.522806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.523036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.523036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0a1aa80-87fe-4597-8cec-26995140600d is going to be updated. [ 896.546376] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.546525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.546611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.546828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.547244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.547423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0a1aa80-87fe-4597-8cec-26995140600d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.919882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.919882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.919882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.919882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.919882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.920317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 896.954626] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.954813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.954911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.955076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.958467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.966195] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 897.020099] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.362984] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 897.363491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.363632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.363863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.364086] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.364221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.364286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.364619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.364742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.364854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.364976] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.525299] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.525413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.525452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.525686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.525783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.525883] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 861f81b8-db22-4a30-a43a-194caa55e446 is going to be created. [ 897.552461] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.552608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.552670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.553070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.553070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.566347] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 861f81b8-db22-4a30-a43a-194caa55e446 in Status: UNINITIALIZED for 2s [ 897.840961] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ad1db59e-986a-4aa8-843f-c7cc12115173 None None] Enqueued Resource ID: 6097d0aa-79d5-401f-8c3e-e1000cf50b1c with Priority: HIGHEST for action port [ 897.841616] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6097d0aa-79d5-401f-8c3e-e1000cf50b1c with Priority: HIGHEST for action port [ 897.841951] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-6097d0aa-79d5-401f-8c3e-e1000cf50b1c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.846871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6097d0aa-79d5-401f-8c3e-e1000cf50b1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.846871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6097d0aa-79d5-401f-8c3e-e1000cf50b1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.846871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6097d0aa-79d5-401f-8c3e-e1000cf50b1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.846871] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6097d0aa-79d5-401f-8c3e-e1000cf50b1c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.869391] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.869547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.869609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.869843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.870017] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.870141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.870224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.870421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.870507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.870541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.870692] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.870788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.871652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.871652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.871652] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.871652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.871652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.871652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.871652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.871652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.871652] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.971240] env[66123]: INFO networking_nsxv3.common.synchronization [None req-b46a1739-b68f-4eee-8e19-1bc4b8b1bc92 tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 897.971901] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 897.972306] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.972373] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.972456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.972749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.972966] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.112973] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d48cd7be-ec07-4ef0-ab75-d53f39172021 tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 898.112973] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 898.113275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.113406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.346365] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6097d0aa-79d5-401f-8c3e-e1000cf50b1c [ 898.346677] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.346847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.346927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.347240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.347363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.347514] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6097d0aa-79d5-401f-8c3e-e1000cf50b1c already deleted. [ 898.347635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6097d0aa-79d5-401f-8c3e-e1000cf50b1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.378366] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8: rpc.has_security_group_logging(os_id): False [ 898.402283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.402283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.402283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.407480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.407480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.407480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.407480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.408463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.408463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.408463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.408463] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 898.506049] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.506289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.506394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.506715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.506914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.509474] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.509647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.509749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.510041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.510226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.510552] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b already deleted. [ 898.510552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.512263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.512263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.512569] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.534867] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 898.978956] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.982020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.982020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.982824] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.983313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.983537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.983762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.983936] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.984068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.984137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.984301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.984391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.984505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.984695] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.037977] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.038141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.038207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.039031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.039031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.039031] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b already deleted. [ 899.039235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.491398] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c33bec6e-2ebe-4c3c-a232-8a79edacefc8: rpc.has_security_group_logging(os_id): False [ 899.511863] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.511983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.512032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.512646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.512646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.512646] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.512646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.512646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.512852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.512881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.513099] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.513208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.513242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.513386] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.513480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.515177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.515293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.515363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.515529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.515602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.515783] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 899.578356] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 861f81b8-db22-4a30-a43a-194caa55e446 in Status: SUCCESS [ 899.578356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.578356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.578356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.578516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.578633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.578703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.578852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.578932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.579320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.579320] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.582702] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.582702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.582702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.582856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.582954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.596214] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 899.716621] env[66123]: INFO networking_nsxv3.common.synchronization [req-55886295-a79a-4fa1-a459-1d896285bb3f req-efae9aa5-310f-4e0b-bd99-0786b869f142 tempest-ImagesOneServerNegativeTestJSON-1403779228 tempest-ImagesOneServerNegativeTestJSON-1403779228-project-member] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 899.716965] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGHEST for action security_group_members [ 899.717612] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.717857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.717857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.717985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.718381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.719015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.719087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.719368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.719368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.719444] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.083046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-861f81b8-db22-4a30-a43a-194caa55e446 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.083046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.083046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.083488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.083488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.083631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.083631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.083794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.083852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.083950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.084134] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-861f81b8-db22-4a30-a43a-194caa55e446 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.084230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.084378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.084596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.084787] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.084852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.084885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.085404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.085539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.085637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.085732] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.222053] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.222053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.222053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.222262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.222325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.223360] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.223360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.223360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.223360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.223360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.223360] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be updated. [ 900.263381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.263553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.263593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.263870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.263955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.277560] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: IN_PROGRESS for 2s [ 900.448791] env[66123]: INFO networking_nsxv3.common.synchronization [req-1f9803c7-19e0-4946-9548-fbd2995e7f86 req-a2c2535a-e302-4487-ab8e-d9873144252d tempest-MigrationsAdminTest-723267321 tempest-MigrationsAdminTest-723267321-project-member] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 900.449433] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGHEST for action security_group_members [ 900.449752] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.449878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.449934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.450230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.450296] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.450394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.450457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.450613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.450692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.451253] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.549927] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 900.550667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.589367] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 861f81b8-db22-4a30-a43a-194caa55e446: rpc.has_security_group_logging(os_id): False [ 900.609101] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.609815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.609815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.609815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.610070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.610443] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.610569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.610617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.611201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.611323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.611826] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.613427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.613553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.613755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.613878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.614154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.614286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.614426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.614598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.614762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.614996] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 861f81b8-db22-4a30-a43a-194caa55e446 is going to be created. [ 900.675853] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.676023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.676084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.676297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.676531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.687953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 861f81b8-db22-4a30-a43a-194caa55e446 in Status: IN_PROGRESS for 2s [ 900.958623] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.958623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.958623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.958623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.977997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.977997] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.977997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.977997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.977997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.977997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.977997] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be updated. [ 901.009036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.009036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.009036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.009036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.009036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.021952] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: IN_PROGRESS for 2s [ 901.615248] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 901.615672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.615881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.616344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.616432] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.119702] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.119901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.119968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.120203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.120353] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.120520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.120592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.120743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.120835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.120942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.121291] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.291835] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 in Status: SUCCESS [ 902.291835] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 deletion is rescheduled due to dependency. [ 902.291835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.624946] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.624946] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.624946] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.624946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.625723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.625723] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.625723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.625723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.625723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.625723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.625723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.625934] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.701454] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 861f81b8-db22-4a30-a43a-194caa55e446 in Status: SUCCESS [ 902.701976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.033140] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 in Status: SUCCESS [ 903.033325] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 deletion is rescheduled due to dependency. [ 903.033442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.129326] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c33bec6e-2ebe-4c3c-a232-8a79edacefc8: rpc.has_security_group_logging(os_id): False [ 903.150320] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.150405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.150440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.150792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.150890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.151148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.151298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.151408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.151654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.151795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.152711] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.152711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.152711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.152711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.152711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.152938] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.153107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.153107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.154068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.154068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.154068] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 903.237742] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.237919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.237990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.238229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.238384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.257280] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 905.280887] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 905.281315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.450635] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 905.450635] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 905.804533] env[66123]: INFO networking_nsxv3.common.synchronization [None req-6fa6ec53-6b12-4dae-bd25-710ec4a4d0e9 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_rules [ 905.805542] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_rules [ 905.805616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.805786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.805876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.807398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.807398] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.074410] env[66123]: INFO networking_nsxv3.common.synchronization [None req-bf5a686e-2b43-44d1-bbc6-86f1a93e6b80 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_rules [ 906.076422] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_rules [ 906.076947] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.077098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.230421] env[66123]: INFO networking_nsxv3.common.synchronization [None req-b84b36a8-cc93-4571-b62c-b59f278c10e9 None None] Enqueued Resource ID: 702bad59-e2fc-4b6e-a5fb-8388a92a0ee5 with Priority: HIGHEST for action port [ 906.230968] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702bad59-e2fc-4b6e-a5fb-8388a92a0ee5 with Priority: HIGHEST for action port [ 906.232513] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-702bad59-e2fc-4b6e-a5fb-8388a92a0ee5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.232661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-702bad59-e2fc-4b6e-a5fb-8388a92a0ee5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.232748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-702bad59-e2fc-4b6e-a5fb-8388a92a0ee5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.233120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-702bad59-e2fc-4b6e-a5fb-8388a92a0ee5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.233230] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('702bad59-e2fc-4b6e-a5fb-8388a92a0ee5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.336027] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.336027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.336027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.336027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.336027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.336027] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce already deleted. [ 906.336027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.336027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.336027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.336625] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.387559] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.387761] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.387883] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.388572] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.390164] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.390164] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.390164] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.390164] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.390463] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.390719] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.390849] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.390954] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.391081] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.391195] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.391297] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.391427] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.413609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.413934] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.414231] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.414574] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-761" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.415071] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.415203] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.415571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.415783] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.416132] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.736744] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 702bad59-e2fc-4b6e-a5fb-8388a92a0ee5 [ 906.737103] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.737244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.737317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.737535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.737632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.737726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:702bad59-e2fc-4b6e-a5fb-8388a92a0ee5 already deleted. [ 906.737809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-702bad59-e2fc-4b6e-a5fb-8388a92a0ee5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.865352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.865483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.865553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.865827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.865991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.866122] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce already deleted. [ 906.866213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.918872] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.919166] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.919318] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.919692] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.919873] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.920251] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.920437] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.920581] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.920899] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.921137] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.921490] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.921657] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.921774] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.922037] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.922185] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.922335] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 is going to be updated. [ 906.952310] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.952564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.952702] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.953097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.953192] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.953473] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.446813] env[66123]: INFO networking_nsxv3.common.synchronization [req-3847a182-1568-4df6-9302-4f40020a2bcb req-2ef18c83-e49b-4624-9610-450b2fe68d3e tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 907.447191] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 907.447592] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.447656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.447759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.447978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.448433] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.448433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.448433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.448951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.448951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.448951] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.707583] env[66123]: INFO networking_nsxv3.common.synchronization [req-7677f2df-21dd-43df-bda5-680cbadae821 req-6d3203a9-7c27-42e1-a66c-8bf7e15e8019 service nova] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_rules [ 907.707583] env[66123]: INFO networking_nsxv3.common.synchronization [req-7677f2df-21dd-43df-bda5-680cbadae821 req-6d3203a9-7c27-42e1-a66c-8bf7e15e8019 service nova] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 907.707583] env[66123]: INFO networking_nsxv3.common.synchronization [req-7677f2df-21dd-43df-bda5-680cbadae821 req-6d3203a9-7c27-42e1-a66c-8bf7e15e8019 service nova] Enqueued Resource ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 with Priority: HIGHEST for action port [ 907.707583] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_rules [ 907.707583] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 907.707583] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 with Priority: HIGHEST for action port [ 907.707583] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.707583] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.707583] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.707583] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.707583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.708429] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.710321] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.710321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.710321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.710321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.711493] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.725083] env[66123]: INFO networking_nsxv3.common.synchronization [req-f58a2769-00fb-473c-b431-dd88a466a525 req-3b050f7a-c0f5-4234-b1bd-68e69af7328f tempest-MultipleCreateTestJSON-832057247 tempest-MultipleCreateTestJSON-832057247-project-member] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 907.727728] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGHEST for action security_group_members [ 907.727728] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.727728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.951556] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.213334] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 with status ACTIVE [ 908.213556] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.213717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.213863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.214210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.214297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.214555] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.214720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.214811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.215025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.215146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.215408] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.215538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.215614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.215774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.215858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.215945] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2 is going to be updated. [ 908.217676] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.218881] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.219035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.242848] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.243056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.243097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.243308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.243457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.243623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ef149b6-6e77-4dc8-b1f4-ba52c7cd8ad2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.396307] env[66123]: INFO networking_nsxv3.common.synchronization [req-0306fa90-35c6-455c-8182-a23241d06743 req-b2d41e74-5495-4514-9c82-d07af2c07f33 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 908.397076] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 908.397457] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.397938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.397938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.397938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.398145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.398230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.398285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.398434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.398545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.398646] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.454816] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.610056] env[66123]: INFO networking_nsxv3.common.synchronization [None req-b0378a1f-d5be-4c71-8a36-9938152d5b02 None None] Enqueued Resource ID: 32725e0d-6c1d-47ee-b22d-4a6dba47763e with Priority: HIGHEST for action port [ 908.610567] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32725e0d-6c1d-47ee-b22d-4a6dba47763e with Priority: HIGHEST for action port [ 908.610880] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-32725e0d-6c1d-47ee-b22d-4a6dba47763e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.611010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32725e0d-6c1d-47ee-b22d-4a6dba47763e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.611170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32725e0d-6c1d-47ee-b22d-4a6dba47763e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.611442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32725e0d-6c1d-47ee-b22d-4a6dba47763e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.611534] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32725e0d-6c1d-47ee-b22d-4a6dba47763e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.720393] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.771363] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.772495] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.772495] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.772495] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.772495] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.772821] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.772883] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.773218] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.773446] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.773760] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.773948] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.774116] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.774300] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.774511] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.774665] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.774902] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.830986] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.831278] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.831410] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.831658] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.832068] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-138c9c3b-fdca-4482-8b7c-444c9097ff89 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.832334] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.832538] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.832947] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.833159] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('138c9c3b-fdca-4482-8b7c-444c9097ff89',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.902522] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.902713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.902769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.903009] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.933328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.933600] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.933724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.933793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.934011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.934097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.934187] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 908.960744] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.960947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.961020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.961265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.961942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.961942] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 908.969790] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.969966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.970042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.970248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.970413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.979461] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 908.998251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.998424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.998480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.998718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.998857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.011771] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 909.113217] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32725e0d-6c1d-47ee-b22d-4a6dba47763e [ 909.113468] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.113582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.113653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.113891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.113979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.114094] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32725e0d-6c1d-47ee-b22d-4a6dba47763e already deleted. [ 909.114177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32725e0d-6c1d-47ee-b22d-4a6dba47763e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.224462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.224462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.224462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.224462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.224462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.224462] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be updated. [ 909.288140] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.288452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.288547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.288777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.289081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.302815] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 909.336011] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.336454] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.336709] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.337050] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.337224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.337413] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 138c9c3b-fdca-4482-8b7c-444c9097ff89 not found, creating... [ 909.337714] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.337899] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.338049] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.338303] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.338468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.338822] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.339019] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.339155] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.339404] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.339587] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.339840] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 138c9c3b-fdca-4482-8b7c-444c9097ff89 is going to be created. [ 909.368786] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.369116] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.369284] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.369682] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.369989] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.370324] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.096975] env[66123]: INFO networking_nsxv3.common.synchronization [req-0306fa90-35c6-455c-8182-a23241d06743 req-e842dfed-8f69-4875-a22f-fb8efdbbfab0 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 910.097604] env[66123]: INFO networking_nsxv3.common.synchronization [req-0306fa90-35c6-455c-8182-a23241d06743 req-e842dfed-8f69-4875-a22f-fb8efdbbfab0 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 910.097604] env[66123]: INFO networking_nsxv3.common.synchronization [req-0306fa90-35c6-455c-8182-a23241d06743 req-e842dfed-8f69-4875-a22f-fb8efdbbfab0 service nova] Enqueued Resource ID: 138c9c3b-fdca-4482-8b7c-444c9097ff89 with Priority: HIGHEST for action port [ 910.098288] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 910.098467] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 910.098598] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 138c9c3b-fdca-4482-8b7c-444c9097ff89 with Priority: HIGHEST for action port [ 910.098945] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.099127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.099234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.099570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.099639] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.102703] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.102848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.103287] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-138c9c3b-fdca-4482-8b7c-444c9097ff89 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.103412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.103500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.103753] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.103847] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('138c9c3b-fdca-4482-8b7c-444c9097ff89',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.605932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.606237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.608219] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 138c9c3b-fdca-4482-8b7c-444c9097ff89 with status ACTIVE [ 910.608219] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.608219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.608377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.608880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.609029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.609326] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.609440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.609481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.609694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.609786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.609997] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.610122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.610202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.610358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.610434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.610520] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 138c9c3b-fdca-4482-8b7c-444c9097ff89 is going to be updated. [ 910.632865] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.633069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.633146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.633372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.633563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.633783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-138c9c3b-fdca-4482-8b7c-444c9097ff89" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.990164] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 910.990535] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 deletion is rescheduled due to dependency. [ 910.990664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.990839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.991212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.991436] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.991582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.991658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.991895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.992039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.992178] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.020865] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 911.021086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.021252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.021472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.021677] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.021797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.021886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.022091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.022193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.022266] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.315065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 911.315065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.315525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.316264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.316264] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.316264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.316488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.316615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.316732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.316967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.317179] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.494130] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.524403] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.524628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.524628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.524822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.524922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.525149] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.525254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.525315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.525471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.525552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.525647] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be updated. [ 911.554913] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.554913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.554913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.554913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.554913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.565530] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: IN_PROGRESS for 2s [ 911.819690] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.819975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.820177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.820513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.820807] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.820989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.821100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.821855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.821855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.821855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.822028] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.822097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.822198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.822510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.822754] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.823713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.823806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.824116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.824207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.824289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.824435] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.996727] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.162278] env[66123]: INFO networking_nsxv3.common.synchronization [req-b50c35dc-8a21-455d-99fd-30d20c85807c req-9537e68e-9621-4079-8735-ef8dd1c69914 tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_members [ 912.162549] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_members [ 912.162844] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.162961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.163040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.163354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.163537] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.163678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.163746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.163944] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.164040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.164132] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.327727] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c: rpc.has_security_group_logging(os_id): False [ 912.351452] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.351679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.352039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.352120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.376536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.376932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.377975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.377975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.377975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.377975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.377975] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.378345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.378345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.378345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.378345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.378590] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.378703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.378772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.378916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.379017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.379096] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be updated. [ 912.464975] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.465186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.465241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.465578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.465745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.479725] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 912.498566] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.498788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.499020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.499194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.499301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.499411] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 912.517843] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.518099] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.518195] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.518541] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.518829] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.518999] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.519131] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.519644] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.519804] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.520176] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.520312] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.520421] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.520529] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.520640] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.520740] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.520870] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.539881] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.540080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.540123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.540750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.540750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.552126] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 912.553489] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.553691] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.553797] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.554067] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-424" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.554456] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-8797dbb1-b730-4129-ad30-97744ec3aed8 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.554763] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.554953] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.555382] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.555598] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8797dbb1-b730-4129-ad30-97744ec3aed8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.666332] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.666532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.666607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.666911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.667058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.667305] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.667417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.667480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.667651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.667745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.667868] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 already deleted. [ 912.667919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.058727] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.058998] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.059329] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.059669] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.059905] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.060145] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 8797dbb1-b730-4129-ad30-97744ec3aed8 not found, creating... [ 913.060476] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.060659] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.060775] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.061045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.061190] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.061524] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.061734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.061927] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.062293] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.062554] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.062795] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 8797dbb1-b730-4129-ad30-97744ec3aed8 is going to be created. [ 913.088323] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.088740] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.088927] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.089319] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.089604] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.089871] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.578553] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 in Status: SUCCESS [ 913.578896] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 deletion is rescheduled due to dependency. [ 913.578977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.802169] env[66123]: INFO networking_nsxv3.common.synchronization [req-b50c35dc-8a21-455d-99fd-30d20c85807c req-d3dd5a43-43a9-436b-aefb-73bc1eaf7085 service nova] Enqueued Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_rules [ 913.802365] env[66123]: INFO networking_nsxv3.common.synchronization [req-b50c35dc-8a21-455d-99fd-30d20c85807c req-d3dd5a43-43a9-436b-aefb-73bc1eaf7085 service nova] Enqueued Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_members [ 913.802499] env[66123]: INFO networking_nsxv3.common.synchronization [req-b50c35dc-8a21-455d-99fd-30d20c85807c req-d3dd5a43-43a9-436b-aefb-73bc1eaf7085 service nova] Enqueued Resource ID: 8797dbb1-b730-4129-ad30-97744ec3aed8 with Priority: HIGHEST for action port [ 913.804032] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_rules [ 913.804207] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_members [ 913.804330] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8797dbb1-b730-4129-ad30-97744ec3aed8 with Priority: HIGHEST for action port [ 913.804665] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.804786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.804853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.805083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.805185] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.807163] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.807275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.807342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.807552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.807718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.807817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.807901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.809440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.809563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.809665] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.811156] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8797dbb1-b730-4129-ad30-97744ec3aed8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.811287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.811358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.811546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.811638] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8797dbb1-b730-4129-ad30-97744ec3aed8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.308189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.308340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.315796] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8797dbb1-b730-4129-ad30-97744ec3aed8 with status ACTIVE [ 914.316067] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.316224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.316339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.316575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.316846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.316944] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.317053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.317053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.317180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.317288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.317437] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.317527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.317574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.317723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.317784] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.317906] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8797dbb1-b730-4129-ad30-97744ec3aed8 is going to be updated. [ 914.319153] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.339904] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.340137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.340137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.340326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.340408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.340575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8797dbb1-b730-4129-ad30-97744ec3aed8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.445028] env[66123]: INFO networking_nsxv3.common.synchronization [None req-4c9641e1-fd3b-4909-b0da-a886e78dc45d tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_rules [ 914.445645] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_rules [ 914.446098] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.446245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.446332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.446616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.447196] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.492827] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 914.493071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.526558] env[66123]: INFO networking_nsxv3.common.synchronization [None req-2a68fb39-d66b-4698-93ec-3bd8e234a9e5 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_rules [ 914.527208] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_rules [ 914.527522] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.527645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.562752] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 914.562940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.563124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.563353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.563594] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.563694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.563741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.563884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.564157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.564157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.564157] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.625184] env[66123]: INFO networking_nsxv3.common.synchronization [req-5e2ff1d0-2020-43f4-b33e-0db806299ea0 req-00f889b5-9361-4604-9af4-aa19a1af38ff tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 914.625452] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 914.625715] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.625873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.625968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.626226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.626466] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.626540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.626712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.626800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.626889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.627040] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.821602] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.970758] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.970933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.971045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.971311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.971415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.971559] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 already deleted. [ 914.971659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.971844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.972010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.972047] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.005205] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.005205] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.005401] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.005482] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.005725] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.005870] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.005979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.006339] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.006600] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.007019] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.007019] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.007196] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.007339] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.007535] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.007993] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.007993] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.030609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.030789] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.030950] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.031186] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.031501] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-65517702-c14a-49a5-8d53-cb9d0e12fb53 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.031674] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.033097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.033097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.033097] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65517702-c14a-49a5-8d53-cb9d0e12fb53',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.066882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.067201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.067239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.067515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.067747] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.067929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.067972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.068976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.068976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.068976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.068976] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.068976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.068976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.068976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.068976] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.069395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.069395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.069395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.069395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.069533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.069584] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.129974] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.325242] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.325437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.325553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.325759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.325863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.325984] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 is going to be created. [ 915.362404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.362687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.363641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.363964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.364192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.379178] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 in Status: UNINITIALIZED for 2s [ 915.501302] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.501302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.501302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.501507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.501507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.501611] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 already deleted. [ 915.501675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.538057] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.538057] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.538057] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.538057] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.538286] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.538353] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 65517702-c14a-49a5-8d53-cb9d0e12fb53 not found, creating... [ 915.538611] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.538785] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.539607] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.539854] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.540029] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.540324] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.540955] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.541099] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.541315] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.541455] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.541596] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 65517702-c14a-49a5-8d53-cb9d0e12fb53 is going to be created. [ 915.564436] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.564712] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.564843] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.565149] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.565386] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.565638] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.572256] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae4b87ee-cc63-4241-b970-23c1a58e9362: rpc.has_security_group_logging(os_id): False [ 915.589737] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.589961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.590052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.590280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.590369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.590559] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.590654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.590722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.590862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.590970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.591177] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.591277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.591329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.591469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.591544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.591726] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.591810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.591862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.592018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.592112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.592171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 915.632070] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.665040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.665155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.665192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.665497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.665654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.694581] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 916.134669] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.134669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.134834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.134955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.135031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.136033] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 916.168443] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.168443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.168443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.168443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.168443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.179290] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 916.332912] env[66123]: INFO networking_nsxv3.common.synchronization [req-5e2ff1d0-2020-43f4-b33e-0db806299ea0 req-222d61f0-4d8f-4032-abf1-1b26ef7217ed service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 916.333115] env[66123]: INFO networking_nsxv3.common.synchronization [req-5e2ff1d0-2020-43f4-b33e-0db806299ea0 req-222d61f0-4d8f-4032-abf1-1b26ef7217ed service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 916.333257] env[66123]: INFO networking_nsxv3.common.synchronization [req-5e2ff1d0-2020-43f4-b33e-0db806299ea0 req-222d61f0-4d8f-4032-abf1-1b26ef7217ed service nova] Enqueued Resource ID: 65517702-c14a-49a5-8d53-cb9d0e12fb53 with Priority: HIGHEST for action port [ 916.333898] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 916.333994] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 916.334118] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65517702-c14a-49a5-8d53-cb9d0e12fb53 with Priority: HIGHEST for action port [ 916.334422] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.334564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.334620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.334849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.334935] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.336738] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.336738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.336738] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-65517702-c14a-49a5-8d53-cb9d0e12fb53 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.337038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.337038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.337120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.338058] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65517702-c14a-49a5-8d53-cb9d0e12fb53',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.592880] env[66123]: INFO networking_nsxv3.common.synchronization [req-bf5a7853-e158-4875-825f-22ac73b1fa88 req-d182b4cb-06f9-498c-9022-37112c399e11 tempest-ImagesNegativeTestJSON-1347675059 tempest-ImagesNegativeTestJSON-1347675059-project-member] Enqueued Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_members [ 916.593373] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861f81b8-db22-4a30-a43a-194caa55e446 with Priority: HIGHEST for action security_group_members [ 916.594393] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-861f81b8-db22-4a30-a43a-194caa55e446 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.594393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.594393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.594393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.594645] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.594691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.594745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.594947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.595074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.595195] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('861f81b8-db22-4a30-a43a-194caa55e446',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.839419] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.839850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.840996] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65517702-c14a-49a5-8d53-cb9d0e12fb53 with status ACTIVE [ 916.841129] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.841398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.841469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.841697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.841787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.841963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.842070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.842129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.842282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.842356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.842579] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.842669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.842731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.843439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.843439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.843439] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65517702-c14a-49a5-8d53-cb9d0e12fb53 is going to be updated. [ 916.859808] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e8024458-3c29-407f-96a1-4ca86c7af2ac tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 916.861059] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 916.861059] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.861059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.861296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.861344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.861865] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.861865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.861865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.861865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.861865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.862152] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.866340] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.866340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.866340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.866518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.866565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.866678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65517702-c14a-49a5-8d53-cb9d0e12fb53" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.098239] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.098417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.098455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.098747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.098880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.099107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.099216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.099278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.099445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.099522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.099612] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 861f81b8-db22-4a30-a43a-194caa55e446 is going to be updated. [ 917.131488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.131488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.131488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.133033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.133033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.144468] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 861f81b8-db22-4a30-a43a-194caa55e446 in Status: IN_PROGRESS for 2s [ 917.333135] env[66123]: INFO networking_nsxv3.common.synchronization [req-f3490810-4e9e-4e06-bb3e-ecf3000f9d80 req-a79e20ac-4fc6-4107-989b-74dab9c3ce16 tempest-ServerAddressesNegativeTestJSON-996546213 tempest-ServerAddressesNegativeTestJSON-996546213-project-member] Enqueued Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_members [ 917.333910] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_members [ 917.336399] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.336399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.336399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.336399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.336399] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.336399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.336399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.337423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.337423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.337423] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.365291] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.390861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 in Status: SUCCESS [ 917.391053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.391257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.391523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.391755] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.391862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.392075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.392287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.392342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.392400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.392535] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.710467] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 917.710696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.753021] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.753021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-314" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.753021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-314" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.753021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-314" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.753021] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.753021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.753021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.753021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.753667] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.754085] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.754291] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.754516] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.754771] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.755183] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.757361] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.757361] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.778759] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.779094] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.779546] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.779607] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-314" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.780332] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-f3a159d3-8b10-4085-a35a-dc3995bc2d21 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.780332] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.780590] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.781141] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.781210] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a159d3-8b10-4085-a35a-dc3995bc2d21',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.842940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.843368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.843368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.843459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.843507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.843735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.843851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.843895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.844079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.844149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.844240] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44fe180-6402-48dd-88de-72f82c8bda2f already deleted. [ 917.844312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.873910] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.906759] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.093250] env[66123]: INFO networking_nsxv3.common.synchronization [req-af642e83-b621-4471-8e47-5353be51b9bf req-61ce5dfa-c98e-497c-91ba-b131640ebfa8 tempest-ServersAdminTestJSON-1653799954 tempest-ServersAdminTestJSON-1653799954-project-member] Enqueued Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 918.093832] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed with Priority: HIGHEST for action security_group_members [ 918.094175] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.094299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.094367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.094680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.094862] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.095015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.095078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.095250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.095350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.095445] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b19fe3-562d-4163-b8e0-7d5f0c6475ed',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.193608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 918.193854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.194246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.194500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.194778] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.194933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.194996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.195203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.195293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.195398] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.285767] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.286026] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.286160] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.286477] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.286819] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.286819] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port f3a159d3-8b10-4085-a35a-dc3995bc2d21 not found, creating... [ 918.287129] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.287305] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.287519] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.287756] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.287882] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.288249] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.288442] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.288548] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.288788] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.288957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.289317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: f3a159d3-8b10-4085-a35a-dc3995bc2d21 is going to be created. [ 918.329980] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.330553] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.330739] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.330926] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.331524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.331524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.383273] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.383725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.383901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.384130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.384238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.384339] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 918.414618] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7b81556-6c94-4aa2-8778-1100ecc2b026: rpc.has_security_group_logging(os_id): False [ 918.420974] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.421227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.421227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.421468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.421630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.439389] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.440068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.440068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.440068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.440068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.440284] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.440453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.440536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.440735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.440868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.441032] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 is going to be created. [ 918.443664] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 918.575928] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.576225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.576277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.577176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.577176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.594247] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 in Status: IN_PROGRESS for 2s [ 918.598026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.598286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.598286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.598609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.633721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.634090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.634836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.634836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.636392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.636392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.636392] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed is going to be updated. [ 918.684998] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.685191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.686145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.686145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.686145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.698657] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.706564] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: IN_PROGRESS for 2s [ 919.083045] env[66123]: INFO networking_nsxv3.common.synchronization [req-f3490810-4e9e-4e06-bb3e-ecf3000f9d80 req-8490ba91-87ac-44ef-abae-5a8474870d6d service nova] Enqueued Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_rules [ 919.083045] env[66123]: INFO networking_nsxv3.common.synchronization [req-f3490810-4e9e-4e06-bb3e-ecf3000f9d80 req-8490ba91-87ac-44ef-abae-5a8474870d6d service nova] Enqueued Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_members [ 919.083045] env[66123]: INFO networking_nsxv3.common.synchronization [req-f3490810-4e9e-4e06-bb3e-ecf3000f9d80 req-8490ba91-87ac-44ef-abae-5a8474870d6d service nova] Enqueued Resource ID: f3a159d3-8b10-4085-a35a-dc3995bc2d21 with Priority: HIGHEST for action port [ 919.083566] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_rules [ 919.083699] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_members [ 919.084110] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3a159d3-8b10-4085-a35a-dc3995bc2d21 with Priority: HIGHEST for action port [ 919.084159] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.084291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.084356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.084656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.085071] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.085937] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.086070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.086411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.086411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.086482] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.086563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.086625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.087019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.087019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.087019] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.087870] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3a159d3-8b10-4085-a35a-dc3995bc2d21 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.087870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.088112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.088112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.088181] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a159d3-8b10-4085-a35a-dc3995bc2d21',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.156681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 861f81b8-db22-4a30-a43a-194caa55e446 in Status: SUCCESS [ 919.156681] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 861f81b8-db22-4a30-a43a-194caa55e446 deletion is rescheduled due to dependency. [ 919.156681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-861f81b8-db22-4a30-a43a-194caa55e446" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.201334] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.589544] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.589714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.590632] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.591779] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3a159d3-8b10-4085-a35a-dc3995bc2d21 with status ACTIVE [ 919.591919] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.592723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.592723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.592723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.592723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.592854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.592854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.592946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.593581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.593581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.593581] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.593825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.593922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.594162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.594208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.594260] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3a159d3-8b10-4085-a35a-dc3995bc2d21 is going to be updated. [ 919.619627] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.620192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.620192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.620286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.620516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.620747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3a159d3-8b10-4085-a35a-dc3995bc2d21" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.705065] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.705065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.705065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.705286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.705327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.705457] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 919.747428] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.747655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.747788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.748329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.748474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.759524] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 919.877153] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.877409] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.877560] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.877830] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.879557] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.879823] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.879978] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.880307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.880463] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.880673] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.880787] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.880892] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.880997] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.881138] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.881268] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.881404] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.905350] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.906957] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 919.906957] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.906957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.906957] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-68c29ffc-618a-4932-ae8c-9313fa8107ad taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.906957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.906957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.907390] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.907541] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c29ffc-618a-4932-ae8c-9313fa8107ad',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.098486] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.410603] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.410917] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.411117] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.411466] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.411664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.411905] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 68c29ffc-618a-4932-ae8c-9313fa8107ad not found, creating... [ 920.412224] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.412435] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.412572] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.412873] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.413274] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.413795] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.414092] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.414321] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.414784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.415031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.415716] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 68c29ffc-618a-4932-ae8c-9313fa8107ad is going to be created. [ 920.437578] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.437812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.437978] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.438365] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.438608] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.438847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.457634] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 920.457924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.601724] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.601960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.601960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.602191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.602309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.602394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44fe180-6402-48dd-88de-72f82c8bda2f is going to be created. [ 920.609340] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 in Status: SUCCESS [ 920.609715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.631500] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.631500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.631500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.631756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.632512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.645108] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44fe180-6402-48dd-88de-72f82c8bda2f in Status: UNINITIALIZED for 2s [ 920.717475] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed in Status: SUCCESS [ 920.717475] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b19fe3-562d-4163-b8e0-7d5f0c6475ed deletion is rescheduled due to dependency. [ 920.717475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b19fe3-562d-4163-b8e0-7d5f0c6475ed" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.793657] env[66123]: INFO networking_nsxv3.common.synchronization [req-c7f2d738-00ba-4d84-a5f9-cf3393446b5c req-a974ca1b-9a09-46d4-b873-9d33f8dd1aa5 tempest-ServersWithSpecificFlavorTestJSON-678692171 tempest-ServersWithSpecificFlavorTestJSON-678692171-project-member] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 920.793657] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGHEST for action security_group_members [ 920.794283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.794627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.794812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.795139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.795497] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.795928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.796125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.796437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.796633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.796830] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.131580] env[66123]: INFO networking_nsxv3.common.synchronization [req-5a20f99c-27ca-4540-81a4-3c566a3eb324 req-6ad8f29a-8f73-4b90-a567-4f0ef4f50d16 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 921.131871] env[66123]: INFO networking_nsxv3.common.synchronization [req-5a20f99c-27ca-4540-81a4-3c566a3eb324 req-6ad8f29a-8f73-4b90-a567-4f0ef4f50d16 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 921.131930] env[66123]: INFO networking_nsxv3.common.synchronization [req-5a20f99c-27ca-4540-81a4-3c566a3eb324 req-6ad8f29a-8f73-4b90-a567-4f0ef4f50d16 service nova] Enqueued Resource ID: 68c29ffc-618a-4932-ae8c-9313fa8107ad with Priority: HIGHEST for action port [ 921.132473] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 921.134071] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 921.134071] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c29ffc-618a-4932-ae8c-9313fa8107ad with Priority: HIGHEST for action port [ 921.134071] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.134758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.134758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.134894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.134974] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.136019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.136281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.136382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.136601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.136786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.136923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.137047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.137189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.137665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.137665] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.138733] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-68c29ffc-618a-4932-ae8c-9313fa8107ad taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.138855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.138966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.139531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.139531] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c29ffc-618a-4932-ae8c-9313fa8107ad',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.215846] env[66123]: INFO networking_nsxv3.common.synchronization [req-0e6ee64e-0b91-4ff1-bd73-d673df1a0b16 req-cd94030d-31a9-4bf3-9d5d-b87afa79c867 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 921.216677] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 921.216762] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.216874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.216946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.217741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.218454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.218454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.218665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.218665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.218831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.218831] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.299921] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.299921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.299921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.299921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.299921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.300401] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.300401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.300401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.300577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.300577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.300675] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be updated. [ 921.335415] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.335572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.335665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.335860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.336022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.358223] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: IN_PROGRESS for 2s [ 921.642480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.643644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.643644] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.644821] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68c29ffc-618a-4932-ae8c-9313fa8107ad with status ACTIVE [ 921.645198] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.645198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.645375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.645441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.646016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.646016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.646016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.646016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.646251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.646251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.646569] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.646656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.646704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.646849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.646929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.647372] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68c29ffc-618a-4932-ae8c-9313fa8107ad is going to be updated. [ 921.677638] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.677813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.678546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.678546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.678546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.678546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68c29ffc-618a-4932-ae8c-9313fa8107ad" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.721139] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.721334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.721380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.721607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.721691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.721848] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.721956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.722016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.722172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.722239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.722328] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 921.765568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.765772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.765772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.766018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.766183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.778743] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 921.778900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.779682] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 921.779879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.780211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.780449] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.780556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.780837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.780837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.780837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.780935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.781484] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.149330] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.283378] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.283680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.283680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.284735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.284735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.284735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.284735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.284957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.285014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.285163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.285319] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.286679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.286679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.286679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.286679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.287083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.287083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.287083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.287083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.287195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.287267] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.655012] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.655012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.655252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.655342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.655506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.655591] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 922.658796] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44fe180-6402-48dd-88de-72f82c8bda2f in Status: SUCCESS [ 922.659149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.659226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.659514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.659622] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.659745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.659839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.660021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.660109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.660202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.660321] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.689712] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.690054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.690327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.690382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.690550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.703447] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 922.794410] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 922.816023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.816023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.816023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.816023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.840417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.840701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.840828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.840924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.841189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.841375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.841755] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.841898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.841969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.842224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.842870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.842962] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.843165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.843232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.843429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.843507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.843620] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 922.916459] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.916459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.916459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.917087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.917087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.938668] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 923.163501] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.163934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.163934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.164210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.164416] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.164525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.164723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.165091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.165162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.165267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.165465] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.165688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.165822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.166069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.166227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.166371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.166458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.166548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.166614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.166795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.166849] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.372831] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3af04420-6b85-4613-8554-92a0065c78dc in Status: SUCCESS [ 923.372831] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3af04420-6b85-4613-8554-92a0065c78dc deletion is rescheduled due to dependency. [ 923.372831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.670662] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d44fe180-6402-48dd-88de-72f82c8bda2f: rpc.has_security_group_logging(os_id): False [ 923.700690] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.700922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.701013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.701293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.701448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.701707] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.701818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.701886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.702701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.702701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.702825] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.702890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.702922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.704046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.704046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.704046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.704046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.704046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.704267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.704367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.704652] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44fe180-6402-48dd-88de-72f82c8bda2f is going to be created. [ 923.798825] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 923.799553] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 923.799553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.805851] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.806010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.806092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.806677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.806982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.821330] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44fe180-6402-48dd-88de-72f82c8bda2f in Status: IN_PROGRESS for 2s [ 924.716070] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 924.716675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.716675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.716948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.717189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.717334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.717396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.717650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.717760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.717862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.717965] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.960974] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 924.961246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.220395] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.220610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.221021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.221021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.221124] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.221201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.221280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.221501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.221633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.221773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.221938] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.222044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.222108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.222256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.222396] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.222543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.222634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.222786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.222864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.222947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.223052] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.718864] env[66123]: INFO networking_nsxv3.common.synchronization [req-1e0d7f75-f6df-4732-aed3-8db9b4130f63 req-4e11deec-ce83-43c3-a27e-16c8173ad159 tempest-ImagesOneServerTestJSON-1373675140 tempest-ImagesOneServerTestJSON-1373675140-project-member] Enqueued Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_members [ 925.719410] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGHEST for action security_group_members [ 925.719710] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.719854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.720109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.720326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.720583] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.720583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.720702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.720791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.720877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.720970] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.725223] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae4b87ee-cc63-4241-b970-23c1a58e9362: rpc.has_security_group_logging(os_id): False [ 925.747297] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.747483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.747569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.747768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.747859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.748082] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.748183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.748246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.748399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.748477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.748718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.748836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.748924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.749624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.749624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.749624] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.749624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.749624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.749858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.749858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.749858] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 925.838893] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.839435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.839435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.839577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.839703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.843887] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d44fe180-6402-48dd-88de-72f82c8bda2f in Status: SUCCESS [ 925.843887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.855849] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 926.051641] env[66123]: INFO networking_nsxv3.common.synchronization [req-d2686da7-a423-40a7-b859-c994d6cb5fda req-d599436e-7208-4c6a-ae8b-2360f43206a1 tempest-ListImageFiltersTestJSON-1076943688 tempest-ListImageFiltersTestJSON-1076943688-project-member] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 926.051641] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 926.052431] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.052775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.052968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.054596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.054596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.054596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.054596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.054596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.054596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.054596] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.223840] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.223994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.223994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.224249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.253455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.253455] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.253455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.253455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.253455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.253455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.253455] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 is going to be updated. [ 926.302742] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.302742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.302921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.303060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.303347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.316141] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 in Status: IN_PROGRESS for 2s [ 926.411152] env[66123]: INFO networking_nsxv3.common.synchronization [None req-cca2370a-2d0c-42ce-ade9-dc020a0bad71 None None] Enqueued Resource ID: a03e7f43-8b49-4ba9-b191-d2a628cc53d7 with Priority: HIGHEST for action port [ 926.411535] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03e7f43-8b49-4ba9-b191-d2a628cc53d7 with Priority: HIGHEST for action port [ 926.411838] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a03e7f43-8b49-4ba9-b191-d2a628cc53d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.415199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a03e7f43-8b49-4ba9-b191-d2a628cc53d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.415199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a03e7f43-8b49-4ba9-b191-d2a628cc53d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.415639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a03e7f43-8b49-4ba9-b191-d2a628cc53d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.415761] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a03e7f43-8b49-4ba9-b191-d2a628cc53d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.475872] env[66123]: INFO networking_nsxv3.common.synchronization [req-29124e4d-7ce8-4b1d-870c-23f09c4cd21c req-f81c8a8f-a511-4512-ba16-03d37b9e2169 tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 926.476162] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 926.476850] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.476992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.477056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.477315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.477517] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.477628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.477704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.477859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.477983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.478145] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.556975] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.919693] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a03e7f43-8b49-4ba9-b191-d2a628cc53d7 [ 926.920057] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.921047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.921047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.921047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.921047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.921255] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a03e7f43-8b49-4ba9-b191-d2a628cc53d7 already deleted. [ 926.921443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a03e7f43-8b49-4ba9-b191-d2a628cc53d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.948533] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.948812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.949031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.949344] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.949603] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.949755] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.950089] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.950089] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.950231] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.952071] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 926.952071] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.952071] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.952071] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.952071] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 926.952071] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.952071] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.973871] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.974062] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 926.974229] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.974375] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.974750] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.978102] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.978102] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.978102] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.978102] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be2c89e-b1c5-41ff-9355-a2a4fca7a074',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.981090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.981312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.981312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.981643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.981643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.981865] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.981996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.982139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.982349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.982450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.982588] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b already deleted. [ 926.982701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.059290] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.479639] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.479982] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.480139] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.480448] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.480760] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.480980] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 not found, creating... [ 927.481349] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.481606] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.481704] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.482025] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.482450] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.482778] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.482970] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.483165] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.483454] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.483617] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.483787] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 is going to be created. [ 927.533925] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.533925] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.533925] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.534230] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.535031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.535031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.561838] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.562043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.562112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.562314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.562407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.562580] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be updated. [ 927.596204] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.596413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.596494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.596781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.596871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.608456] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: IN_PROGRESS for 2s [ 927.877156] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 927.877156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.307345] env[66123]: INFO networking_nsxv3.common.synchronization [req-29124e4d-7ce8-4b1d-870c-23f09c4cd21c req-c35ca704-493b-4c33-bc6e-8ac6e86493d1 service nova] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 928.307345] env[66123]: INFO networking_nsxv3.common.synchronization [req-29124e4d-7ce8-4b1d-870c-23f09c4cd21c req-c35ca704-493b-4c33-bc6e-8ac6e86493d1 service nova] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 928.307548] env[66123]: INFO networking_nsxv3.common.synchronization [req-29124e4d-7ce8-4b1d-870c-23f09c4cd21c req-c35ca704-493b-4c33-bc6e-8ac6e86493d1 service nova] Enqueued Resource ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 with Priority: HIGHEST for action port [ 928.308422] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 928.308595] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 928.308773] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 with Priority: HIGHEST for action port [ 928.309015] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.309193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.309243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.309424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.309509] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.311444] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.311576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.311638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.311844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.312117] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.312235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.312303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.312474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.312652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.312745] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.313694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.313806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.313868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.314043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.314127] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be2c89e-b1c5-41ff-9355-a2a4fca7a074',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.334326] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 in Status: SUCCESS [ 928.334732] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 deletion is rescheduled due to dependency. [ 928.335195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.691128] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1fd36c5f-3797-4027-99c9-b71d97463171 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 928.691707] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 928.692064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.692224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.692304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.692587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.692968] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.818012] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.818140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.818334] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.819866] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 with status ACTIVE [ 928.819866] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.819866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.819866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.819866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.819866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.820950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.820950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.820950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.821397] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 is going to be updated. [ 928.845384] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.845580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.845728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.845966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.846153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.846340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.878065] env[66123]: INFO networking_nsxv3.common.synchronization [None req-179e1f46-0347-4c1d-af2c-98746d0ee2ca tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 928.878631] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 928.880063] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.880063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.004245] env[66123]: INFO networking_nsxv3.common.synchronization [None req-5f77d371-fae2-4d69-bf46-77b12a5579a8 None None] Enqueued Resource ID: 1b156ee7-7796-4061-a0c7-1af60812a899 with Priority: HIGHEST for action port [ 929.004313] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b156ee7-7796-4061-a0c7-1af60812a899 with Priority: HIGHEST for action port [ 929.004660] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b156ee7-7796-4061-a0c7-1af60812a899 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.005864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b156ee7-7796-4061-a0c7-1af60812a899" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.005864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b156ee7-7796-4061-a0c7-1af60812a899" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.005864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b156ee7-7796-4061-a0c7-1af60812a899" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.005864] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b156ee7-7796-4061-a0c7-1af60812a899',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.216828] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.216828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.216828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.216828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.217033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.217187] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a already deleted. [ 929.217233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.217541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.217541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.217650] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.323137] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.508065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b156ee7-7796-4061-a0c7-1af60812a899 [ 929.509353] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.509353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.509353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.509353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.509353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.509353] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b156ee7-7796-4061-a0c7-1af60812a899 already deleted. [ 929.509353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b156ee7-7796-4061-a0c7-1af60812a899" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.619264] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: SUCCESS [ 929.619482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.649586] env[66123]: INFO networking_nsxv3.common.synchronization [req-9b165888-73b5-433a-b879-634d351bead8 req-f0ecb1c7-f5d7-4fcb-80ec-9c880f24694a tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 929.650146] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 929.651040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.651040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.651040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.651040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.651040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.651276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.651276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.651374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.651374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.651466] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.748392] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.748544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.748616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.748875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.748998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.749139] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a already deleted. [ 929.749275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.826137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.826286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.826359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.826580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.827140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.827368] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b is going to be created. [ 929.851694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.852132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.852235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.852427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.852585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.865782] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: UNINITIALIZED for 2s [ 930.126690] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.127252] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.127603] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.127978] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.128343] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.128581] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.128722] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.129119] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.129327] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.129580] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.129717] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.129839] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.130013] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.130158] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.130302] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.130464] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.151780] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.151988] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.152197] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.152413] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.152789] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-c09ef931-af2c-4a6c-a230-32e6418ee609 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.153115] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.153198] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.153512] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.153669] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09ef931-af2c-4a6c-a230-32e6418ee609',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.154768] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.154904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.154959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.155133] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.177125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.177400] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.177573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.177682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.177901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.177987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.178103] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 930.206501] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.206725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.206863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.207198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.207356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.222024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 930.660546] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.660546] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port c09ef931-af2c-4a6c-a230-32e6418ee609 not found, creating... [ 930.660546] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.660546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.661376] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.661376] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.661376] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.661376] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.661376] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.661376] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: c09ef931-af2c-4a6c-a230-32e6418ee609 is going to be created. [ 930.682603] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.682603] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.682861] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.683401] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.683530] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.683777] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.436800] env[66123]: INFO networking_nsxv3.common.synchronization [req-9b165888-73b5-433a-b879-634d351bead8 req-4c681f30-c6f6-4e83-8387-19d031d09e20 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 931.436981] env[66123]: INFO networking_nsxv3.common.synchronization [req-9b165888-73b5-433a-b879-634d351bead8 req-4c681f30-c6f6-4e83-8387-19d031d09e20 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 931.437077] env[66123]: INFO networking_nsxv3.common.synchronization [req-9b165888-73b5-433a-b879-634d351bead8 req-4c681f30-c6f6-4e83-8387-19d031d09e20 service nova] Enqueued Resource ID: c09ef931-af2c-4a6c-a230-32e6418ee609 with Priority: HIGHEST for action port [ 931.437887] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 931.437887] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 931.437887] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c09ef931-af2c-4a6c-a230-32e6418ee609 with Priority: HIGHEST for action port [ 931.438304] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.438451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.438579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.438870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.438870] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.440403] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.440403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.442604] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-c09ef931-af2c-4a6c-a230-32e6418ee609 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.442740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.443202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.443412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.443782] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09ef931-af2c-4a6c-a230-32e6418ee609',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.793606] env[66123]: INFO networking_nsxv3.common.synchronization [req-ddf4656c-8605-400d-8220-daf7f1ee001d req-ec1e3ead-b08a-4733-8799-ab4e980abba8 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 931.794113] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 931.794429] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.794549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.794617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.794840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.795226] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.795336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.795336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.795465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.795549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.795652] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.876411] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: SUCCESS [ 931.876505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.880019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.880019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.880019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.880019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.880019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.880019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.880019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.880019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.880019] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.946679] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c09ef931-af2c-4a6c-a230-32e6418ee609 with status ACTIVE [ 931.946898] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.947042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.947136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.947371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.947469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.947654] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.947768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.947828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.947996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.948082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.948281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.948370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.948429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.948619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.948655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.948752] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c09ef931-af2c-4a6c-a230-32e6418ee609 is going to be updated. [ 931.951716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.951845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.979227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.979971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.979971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.979971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.980274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.980750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c09ef931-af2c-4a6c-a230-32e6418ee609" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.233387] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 4s [ 932.303743] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.380658] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.804444] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.884726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92becbac-4b94-45df-b2f4-6067bd78d31b: rpc.has_security_group_logging(os_id): False [ 932.903734] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.903896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.903952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.904633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.904633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.904633] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.904633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.904857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.904888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.904959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.905061] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b is going to be created. [ 932.968587] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.968751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.968808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.969034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.969236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.982674] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: IN_PROGRESS for 2s [ 933.310539] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.310905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.310905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.312316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.312316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.312316] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 933.344485] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.344485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.344485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.344626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.344705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.353763] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 934.248687] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 934.248687] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 934.248687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.248687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.248687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.248687] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.248687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.248687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.248687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.248687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.248687] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.751069] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.979136] env[66123]: INFO networking_nsxv3.common.synchronization [req-bd391e49-e860-4033-a1d8-c56396bffd32 req-d5907b0b-29fb-4a6c-bfed-e6d5bd438515 tempest-ServerAddressesNegativeTestJSON-996546213 tempest-ServerAddressesNegativeTestJSON-996546213-project-member] Enqueued Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_members [ 934.979688] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGHEST for action security_group_members [ 934.980438] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.980711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.980779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.981098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.981354] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.981589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.981786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.982050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.982193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.982367] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.996768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: SUCCESS [ 934.996908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.253116] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.365120] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 935.365345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.487106] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.487106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.487106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.487106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.487106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.487428] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.487428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.487500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.487626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.487701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.487788] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44fe180-6402-48dd-88de-72f82c8bda2f is going to be updated. [ 935.517926] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.517926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.517926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.517926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.517926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.528973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44fe180-6402-48dd-88de-72f82c8bda2f in Status: IN_PROGRESS for 2s [ 935.755943] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.755943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.755943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.755943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.755943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.756732] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 935.788407] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.788576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.788629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.789739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.789739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.798453] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 936.399396] env[66123]: INFO networking_nsxv3.common.synchronization [req-31806942-19e1-4f33-80fb-b66b663fa8f3 req-c70a805a-5c33-4ed8-9ee1-98808a67b368 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_members [ 936.400395] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_members [ 936.401312] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.401312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.401312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.401606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.401760] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.401849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.401914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.402086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.402200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.402290] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.542879] env[66123]: INFO networking_nsxv3.common.synchronization [None req-17a28d75-63d3-4ce9-b696-4526e12a1ad4 None None] Enqueued Resource ID: e2e99b03-cd62-4912-bc78-a4be33a50b56 with Priority: HIGHEST for action port [ 936.543406] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e99b03-cd62-4912-bc78-a4be33a50b56 with Priority: HIGHEST for action port [ 936.543757] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2e99b03-cd62-4912-bc78-a4be33a50b56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.543909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2e99b03-cd62-4912-bc78-a4be33a50b56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.544008] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2e99b03-cd62-4912-bc78-a4be33a50b56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.545102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2e99b03-cd62-4912-bc78-a4be33a50b56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.545196] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2e99b03-cd62-4912-bc78-a4be33a50b56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.788823] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.789031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.789162] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.789512] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.794473] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.794803] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.794953] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.795267] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.795421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.795643] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.795797] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.795897] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.796013] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.796127] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.796234] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.796366] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.816282] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.816490] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 936.816586] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.816768] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.817328] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-560d130a-7236-42bc-aaa0-8706d59ee234 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.817532] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.817720] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.817996] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.818154] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('560d130a-7236-42bc-aaa0-8706d59ee234',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.904616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.904908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.905013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.905314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.905457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.905702] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.905835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.905889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.906080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.906164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.906259] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce already deleted. [ 936.906343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.048410] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2e99b03-cd62-4912-bc78-a4be33a50b56 [ 937.048647] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.048781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.048852] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.049125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.049225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.049321] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2e99b03-cd62-4912-bc78-a4be33a50b56 already deleted. [ 937.049409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2e99b03-cd62-4912-bc78-a4be33a50b56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.321159] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.321398] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.321524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.321812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.321963] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.322135] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 560d130a-7236-42bc-aaa0-8706d59ee234 not found, creating... [ 937.322391] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.322544] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.322688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.322941] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.323093] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.323368] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.323550] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.323628] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.323829] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.323987] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.324145] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 560d130a-7236-42bc-aaa0-8706d59ee234 is going to be created. [ 937.355645] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.355645] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.355645] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.355645] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.355941] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.355941] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.563378] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d44fe180-6402-48dd-88de-72f82c8bda2f in Status: SUCCESS [ 937.563378] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d44fe180-6402-48dd-88de-72f82c8bda2f deletion is rescheduled due to dependency. [ 937.563378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.811432] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 937.811668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.811956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.813244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.813244] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.813244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.813244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.813244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.813244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.813244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.813244] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.926876] env[66123]: INFO networking_nsxv3.common.synchronization [None req-66e8d962-e37d-4289-9f18-64a8b83132e8 tempest-ServersV294TestFqdnHostnames-1740533811 tempest-ServersV294TestFqdnHostnames-1740533811-project-member] Enqueued Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_rules [ 937.928517] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_rules [ 937.928517] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f8a69fc-5713-4493-96dc-78b604a9517d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.928517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.928517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.928517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.928517] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.151803] env[66123]: INFO networking_nsxv3.common.synchronization [req-31806942-19e1-4f33-80fb-b66b663fa8f3 req-2df704c3-2809-4989-a1d4-e81f6c166961 service nova] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_rules [ 938.151803] env[66123]: INFO networking_nsxv3.common.synchronization [req-31806942-19e1-4f33-80fb-b66b663fa8f3 req-2df704c3-2809-4989-a1d4-e81f6c166961 service nova] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_members [ 938.151972] env[66123]: INFO networking_nsxv3.common.synchronization [req-31806942-19e1-4f33-80fb-b66b663fa8f3 req-2df704c3-2809-4989-a1d4-e81f6c166961 service nova] Enqueued Resource ID: 560d130a-7236-42bc-aaa0-8706d59ee234 with Priority: HIGHEST for action port [ 938.154497] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_rules [ 938.154497] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_members [ 938.154497] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560d130a-7236-42bc-aaa0-8706d59ee234 with Priority: HIGHEST for action port [ 938.154497] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.154497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.154497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.154497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.154497] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.154497] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.154497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.154497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.154908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.154908] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.154908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.154908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.155056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.155894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.155894] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.156318] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-560d130a-7236-42bc-aaa0-8706d59ee234 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.156392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.156454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.157543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.157543] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('560d130a-7236-42bc-aaa0-8706d59ee234',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.207033] env[66123]: INFO networking_nsxv3.common.synchronization [req-ea4b4804-d438-4424-bcaa-c5fba153e934 req-a3a6a7c1-4329-445c-8c2d-9aa0c5bb0b34 tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 938.207845] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 938.207845] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.207845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.207845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.208088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.208088] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.208162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.208193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.208317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.208398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.208489] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.255901] env[66123]: INFO networking_nsxv3.common.synchronization [None req-a0c93933-6f18-4f37-9976-6111eb202de2 tempest-ServersV294TestFqdnHostnames-1740533811 tempest-ServersV294TestFqdnHostnames-1740533811-project-member] Enqueued Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_rules [ 938.256742] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_rules [ 938.257125] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f8a69fc-5713-4493-96dc-78b604a9517d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.257239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.315893] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.316985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.316985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.316985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.316985] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.316985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.316985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.316985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.316985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.317393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.317393] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.317460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.317516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.317751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.317906] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.318041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.318129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.318304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.318407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.318515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.318636] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.449381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.449606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.449782] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.450037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.450176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.450325] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f8a69fc-5713-4493-96dc-78b604a9517d already deleted. [ 938.450510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.450734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.450984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.451147] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.658747] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.659065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.659173] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.660175] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 560d130a-7236-42bc-aaa0-8706d59ee234 with status ACTIVE [ 938.661445] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.661445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.661445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.661445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.661730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.661730] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.661842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.661842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.662518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.662518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.662643] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.662710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.662710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.662877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.663418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.663512] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 560d130a-7236-42bc-aaa0-8706d59ee234 is going to be updated. [ 938.687281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.687449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.687558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.687781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.687976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.688175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-560d130a-7236-42bc-aaa0-8706d59ee234" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.710915] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.711304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.711304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.711460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.711460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.711664] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.711752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.711816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.711965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.713442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.713442] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 938.779201] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.779201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.779201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.779201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.779201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.789127] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 938.821299] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b3e626-c03f-466a-b911-e8ab22cc99de: rpc.has_security_group_logging(os_id): False [ 938.843022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.843022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.843022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.843824] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.843824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.843824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.843824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.843824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.847281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.847281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.847281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.847281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.847281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.847281] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 938.933935] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.934151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.934211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.934427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.934595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.953668] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 938.985306] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.985494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.985550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.985877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.986264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.986264] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f8a69fc-5713-4493-96dc-78b604a9517d already deleted. [ 938.986264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.167198] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.264917] env[66123]: INFO networking_nsxv3.common.synchronization [None req-050b0b0c-31b7-4c4a-8cb2-c3170da0838c None None] Enqueued Resource ID: d8a8453a-39de-4cc6-bed1-041f31e47b17 with Priority: HIGHEST for action port [ 939.268534] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a8453a-39de-4cc6-bed1-041f31e47b17 with Priority: HIGHEST for action port [ 939.269080] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8a8453a-39de-4cc6-bed1-041f31e47b17 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.269255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8a8453a-39de-4cc6-bed1-041f31e47b17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.269255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8a8453a-39de-4cc6-bed1-041f31e47b17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.269614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8a8453a-39de-4cc6-bed1-041f31e47b17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.269737] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8a8453a-39de-4cc6-bed1-041f31e47b17',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.397034] env[66123]: INFO networking_nsxv3.common.synchronization [req-ad44e02a-35f5-486b-b742-266cec9fe5d9 req-7f7edee9-a30b-4a5d-a182-8d044c611c00 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 939.400901] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 939.402819] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.402819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.402819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.403331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.403463] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.403569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.403633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.403797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.404470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.404582] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.671515] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.671885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.671885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.671980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.672037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.672158] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce is going to be created. [ 939.699994] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.700155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.700217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.700905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.700905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.712078] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: UNINITIALIZED for 2s [ 939.775963] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8a8453a-39de-4cc6-bed1-041f31e47b17 [ 939.775963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.776246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.776246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.776464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.776558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.776652] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8a8453a-39de-4cc6-bed1-041f31e47b17 already deleted. [ 939.776735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8a8453a-39de-4cc6-bed1-041f31e47b17" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.907104] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.176672] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ac1935d4-f93a-4040-a7c1-4cd8770d8edc tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 940.177839] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 940.177839] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.178158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.409979] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.800563] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 940.800853] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 deletion is rescheduled due to dependency. [ 940.800904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.913870] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.914092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.914138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.914322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.914410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.914507] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 940.948398] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.948559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.948559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.948829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.948917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.959564] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 940.970550] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 940.970774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.975198] env[66123]: INFO networking_nsxv3.common.synchronization [req-0fdb51b3-9c5e-4356-9032-6b6d7d25e441 req-d4257601-f91e-4d0b-9290-b5029814a076 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_members [ 940.975198] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_members [ 940.975413] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.975529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.975602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.975882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.976041] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.976189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.976235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.976387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.976470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.976595] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.432650] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.432872] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.433106] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.433416] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.434148] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.434148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.434148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.434594] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.437846] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.437846] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.437846] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.437846] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.437846] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.437846] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.437846] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.437846] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.459397] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.459687] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.459885] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.460414] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.460550] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-cacb5344-17e2-4baf-b862-e34aad6ac39c taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.460818] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.460993] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.461377] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.461572] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacb5344-17e2-4baf-b862-e34aad6ac39c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.479082] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.479367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.479367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.479476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.479594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.479815] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.479922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.479984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.480170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.484226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.484489] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 already deleted. [ 941.484489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.726849] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: SUCCESS [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.726849] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.726849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.726849] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.971728] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.971728] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port cacb5344-17e2-4baf-b862-e34aad6ac39c not found, creating... [ 941.971728] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.971728] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.972730] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.972730] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.972730] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.972730] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.972730] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.972730] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: cacb5344-17e2-4baf-b862-e34aad6ac39c is going to be created. [ 942.011836] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.012210] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.013111] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.013111] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.013893] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.014295] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.229807] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.735024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f1f52d-14fb-4485-8ef3-6e0cc6291fce: rpc.has_security_group_logging(os_id): False [ 942.735024] env[66123]: INFO networking_nsxv3.common.synchronization [req-0fdb51b3-9c5e-4356-9032-6b6d7d25e441 req-1ed92b98-887d-4ebf-b0aa-aa9766a5d192 service nova] Enqueued Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_rules [ 942.735852] env[66123]: INFO networking_nsxv3.common.synchronization [req-0fdb51b3-9c5e-4356-9032-6b6d7d25e441 req-1ed92b98-887d-4ebf-b0aa-aa9766a5d192 service nova] Enqueued Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_members [ 942.735946] env[66123]: INFO networking_nsxv3.common.synchronization [req-0fdb51b3-9c5e-4356-9032-6b6d7d25e441 req-1ed92b98-887d-4ebf-b0aa-aa9766a5d192 service nova] Enqueued Resource ID: cacb5344-17e2-4baf-b862-e34aad6ac39c with Priority: HIGHEST for action port [ 942.736695] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_rules [ 942.736842] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_members [ 942.736956] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacb5344-17e2-4baf-b862-e34aad6ac39c with Priority: HIGHEST for action port [ 942.738346] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.738449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.738515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.738721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.738813] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.740605] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.740605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.740605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.741534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.741666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.741778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.743018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.743018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.743018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.743018] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.743584] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-cacb5344-17e2-4baf-b862-e34aad6ac39c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.743691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.743756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.743915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.743988] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacb5344-17e2-4baf-b862-e34aad6ac39c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.756597] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.758074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.758074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.758074] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce is going to be created. [ 942.830127] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.830346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.830346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.830539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.830718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.843570] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: IN_PROGRESS for 2s [ 942.983688] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 942.983990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.984232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.984469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.984671] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.984825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.984902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.985081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.985167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.985265] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.248408] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cacb5344-17e2-4baf-b862-e34aad6ac39c with status ACTIVE [ 943.248669] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.248811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.248885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.249212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.249212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.249834] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.249834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.249834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.249834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.249834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.250103] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.250103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.254248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.254532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.254566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.254677] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cacb5344-17e2-4baf-b862-e34aad6ac39c is going to be updated. [ 943.255956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.256091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.256256] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.290708] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.291060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.291244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.291535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.292298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.292298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cacb5344-17e2-4baf-b862-e34aad6ac39c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.327992] env[66123]: INFO networking_nsxv3.common.synchronization [req-76b9d50e-014a-4658-8bb6-1dfbe57e7000 req-67fb38d9-746c-4fb2-bc7e-27f797ea9e67 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_members [ 943.328980] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGHEST for action security_group_members [ 943.329285] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.329726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.329726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.330574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.330574] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.330574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.330574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.330574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.330871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.330871] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.489814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.489814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.489814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.489814] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 943.523211] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.523411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.523506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.523695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.523834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.540705] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 943.758502] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.838786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.839409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.839409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.839518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.863820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.863820] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.863820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.863820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.863820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.863820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.863820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48aac306-03a8-4928-8815-44ca0617408c is going to be updated. [ 943.909283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.909283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.909283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.909525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.909690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.920875] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48aac306-03a8-4928-8815-44ca0617408c in Status: IN_PROGRESS for 2s [ 944.262098] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.262098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.262098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.263111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.263111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.263111] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 is going to be created. [ 944.325113] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.325278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.325324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.325612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.325748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.344633] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 in Status: UNINITIALIZED for 2s [ 944.864167] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: SUCCESS [ 944.864529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.551154] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 945.551535] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 deletion is rescheduled due to dependency. [ 945.551535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.583521] env[66123]: INFO networking_nsxv3.common.synchronization [None req-9cae1896-29b5-4a63-ba1f-aaf5c952c95f None None] Enqueued Resource ID: be812b89-a153-496c-9371-f37a033ccd11 with Priority: HIGHEST for action port [ 945.583521] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be812b89-a153-496c-9371-f37a033ccd11 with Priority: HIGHEST for action port [ 945.583521] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-be812b89-a153-496c-9371-f37a033ccd11 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.583809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be812b89-a153-496c-9371-f37a033ccd11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.583809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be812b89-a153-496c-9371-f37a033ccd11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.583936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be812b89-a153-496c-9371-f37a033ccd11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.584403] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be812b89-a153-496c-9371-f37a033ccd11',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.934833] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48aac306-03a8-4928-8815-44ca0617408c in Status: SUCCESS [ 945.935499] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48aac306-03a8-4928-8815-44ca0617408c deletion is rescheduled due to dependency. [ 945.935499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.086218] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be812b89-a153-496c-9371-f37a033ccd11 [ 946.086548] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.086746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.086828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.087096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.087224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.087335] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be812b89-a153-496c-9371-f37a033ccd11 already deleted. [ 946.087452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be812b89-a153-496c-9371-f37a033ccd11" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.363265] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 in Status: SUCCESS [ 946.364444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.367025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.367025] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.777560] env[66123]: INFO networking_nsxv3.common.synchronization [req-86f38713-aa10-4e1f-bed4-d1c794f72b53 req-3d6b74b1-de8d-42dd-8fe8-0ae57fc44b43 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 946.778182] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 946.778392] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.778521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.779139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.780770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.780770] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.780770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.780770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.780770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.780770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.780770] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.870123] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.286957] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.286957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.286957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.287380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.287380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.287487] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.287573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.287636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.287761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.287842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.287929] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 947.317695] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.317695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.318209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.318627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.318627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.331638] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 947.365975] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.366570] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.366704] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.366977] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.367509] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.367689] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.367808] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.368049] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.368195] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.368718] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.368967] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.369108] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.369218] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.369334] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.369440] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.369569] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.371087] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0: rpc.has_security_group_logging(os_id): False [ 947.403861] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.403995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.404083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.404310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.404399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.404649] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.404789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.404859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.405048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.405132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.405224] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 is going to be created. [ 947.412171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.412291] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.412426] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.412608] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.412907] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-8471378a-38b4-4901-b295-20169ecce1d7 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.413086] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.413235] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.413528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.413663] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8471378a-38b4-4901-b295-20169ecce1d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.495607] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.495717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.495774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.496540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.496540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.510021] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 in Status: IN_PROGRESS for 2s [ 947.917660] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.918607] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.918607] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.919619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.919619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.919619] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 8471378a-38b4-4901-b295-20169ecce1d7 not found, creating... [ 947.919619] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.919973] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.920665] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.920665] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.920665] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.921048] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.921271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.921506] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.921814] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.922127] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.922334] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 8471378a-38b4-4901-b295-20169ecce1d7 is going to be created. [ 947.962465] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.963531] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.963531] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.963672] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.963866] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.964062] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.210865] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1e490833-0d5d-44ca-8591-7a9c4115fd04 None None] Enqueued Resource ID: 9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a with Priority: HIGHEST for action port [ 948.211479] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a with Priority: HIGHEST for action port [ 948.211814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.211971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.212061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.212316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.212404] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.715239] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a [ 948.715239] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.715239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.715239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.715448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.715478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.715573] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a already deleted. [ 948.715661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d96b7b0-7aa2-4bcb-bcb1-ca58b51e298a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.719418] env[66123]: INFO networking_nsxv3.common.synchronization [req-86f38713-aa10-4e1f-bed4-d1c794f72b53 req-c4c9f992-99e1-4143-b0a4-4b99b44db37a service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 948.719561] env[66123]: INFO networking_nsxv3.common.synchronization [req-86f38713-aa10-4e1f-bed4-d1c794f72b53 req-c4c9f992-99e1-4143-b0a4-4b99b44db37a service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 948.719656] env[66123]: INFO networking_nsxv3.common.synchronization [req-86f38713-aa10-4e1f-bed4-d1c794f72b53 req-c4c9f992-99e1-4143-b0a4-4b99b44db37a service nova] Enqueued Resource ID: 8471378a-38b4-4901-b295-20169ecce1d7 with Priority: HIGHEST for action port [ 948.720208] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 948.720369] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 948.721028] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8471378a-38b4-4901-b295-20169ecce1d7 with Priority: HIGHEST for action port [ 948.721028] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.721028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.721028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.721528] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.721528] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.722031] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.722165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.723403] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8471378a-38b4-4901-b295-20169ecce1d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.723403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.723403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.723403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.723403] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8471378a-38b4-4901-b295-20169ecce1d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.226462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.226462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.226462] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8471378a-38b4-4901-b295-20169ecce1d7 with status ACTIVE [ 949.226462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.226462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.226462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.226462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.226462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.226462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.226462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.226462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.226989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.226989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.226989] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.226989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.226989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.227157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.227185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.227301] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8471378a-38b4-4901-b295-20169ecce1d7 is going to be updated. [ 949.255193] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.255642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.255642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.255642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.255781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.255981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8471378a-38b4-4901-b295-20169ecce1d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.349241] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 949.349436] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 949.349553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.349722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.349940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.350145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.350267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.350332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.350485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.350567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.350661] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.527934] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 in Status: SUCCESS [ 949.528479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.856021] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.358135] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.859648] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.859855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.860025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.860120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.860213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.860316] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 950.897150] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.897150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.897150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.897150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.897150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.905213] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 952.371384] env[66123]: INFO networking_nsxv3.common.synchronization [None req-275b5773-b23f-460f-a755-e5285754b1c8 None None] Enqueued Resource ID: 71c91435-135e-47a3-a086-dc5b5a4a0607 with Priority: HIGHEST for action port [ 952.372097] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71c91435-135e-47a3-a086-dc5b5a4a0607 with Priority: HIGHEST for action port [ 952.372329] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-71c91435-135e-47a3-a086-dc5b5a4a0607 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.372460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71c91435-135e-47a3-a086-dc5b5a4a0607" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.372562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71c91435-135e-47a3-a086-dc5b5a4a0607" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.372939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71c91435-135e-47a3-a086-dc5b5a4a0607" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.373337] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c91435-135e-47a3-a086-dc5b5a4a0607',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.875140] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71c91435-135e-47a3-a086-dc5b5a4a0607 [ 952.875392] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.875526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.875598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.877484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.877484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.877484] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71c91435-135e-47a3-a086-dc5b5a4a0607 already deleted. [ 952.877484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71c91435-135e-47a3-a086-dc5b5a4a0607" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.918069] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 952.918504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.918504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.919141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.919141] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.919141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.919141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.919329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.919329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.919437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.919487] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.423232] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.423764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.423764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.423764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.423876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.423948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.424027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.424193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.424288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.424388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.424519] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.424614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.424717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.424857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.424958] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.425057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.425114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.425248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.425477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.425477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.425477] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.928558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9172499c-e925-4db8-91df-db6b7bc0f5c2: rpc.has_security_group_logging(os_id): False [ 953.947116] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.947381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.947381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.947499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.947545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.947803] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.947942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.947942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.948053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.948126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.948299] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.948390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.948454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.949252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.949252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.949252] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.949252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.949252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.949449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.949449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.949449] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 954.027175] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.027175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.027175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.027175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.027175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.040584] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 955.933675] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e5a57b7c-42b1-4410-9251-96b1475f73c1 None None] Enqueued Resource ID: 9b86aa81-daa5-47ce-8ee9-31bfd423caac with Priority: HIGHEST for action port [ 955.935523] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b86aa81-daa5-47ce-8ee9-31bfd423caac with Priority: HIGHEST for action port [ 955.936133] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b86aa81-daa5-47ce-8ee9-31bfd423caac taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.936309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b86aa81-daa5-47ce-8ee9-31bfd423caac" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.936419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b86aa81-daa5-47ce-8ee9-31bfd423caac" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.936724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b86aa81-daa5-47ce-8ee9-31bfd423caac" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.936849] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b86aa81-daa5-47ce-8ee9-31bfd423caac',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.059850] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 956.060184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.159339] env[66123]: INFO networking_nsxv3.common.synchronization [req-667f00b6-6a88-4c99-8caf-28b37946da7d req-1f052dc8-3bbc-463a-86f2-e14d7831ad1d tempest-SecurityGroupRulesTestJSON-2134659234 tempest-SecurityGroupRulesTestJSON-2134659234-project-member] Enqueued Resource ID: 2a611e9a-58be-442e-a9e0-40ccb59ac5ea with Priority: HIGHEST for action security_group_rules [ 956.159339] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a611e9a-58be-442e-a9e0-40ccb59ac5ea with Priority: HIGHEST for action security_group_rules [ 956.159644] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a611e9a-58be-442e-a9e0-40ccb59ac5ea taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.159722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a611e9a-58be-442e-a9e0-40ccb59ac5ea" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.159756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a611e9a-58be-442e-a9e0-40ccb59ac5ea" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.161090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a611e9a-58be-442e-a9e0-40ccb59ac5ea" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.162082] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a611e9a-58be-442e-a9e0-40ccb59ac5ea',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.440325] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b86aa81-daa5-47ce-8ee9-31bfd423caac [ 956.440568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.440714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.440786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.441041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.441116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.441212] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b86aa81-daa5-47ce-8ee9-31bfd423caac already deleted. [ 956.441292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b86aa81-daa5-47ce-8ee9-31bfd423caac" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.689321] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.689321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.689321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.689321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.689321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.689321] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a611e9a-58be-442e-a9e0-40ccb59ac5ea already deleted. [ 956.689321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a611e9a-58be-442e-a9e0-40ccb59ac5ea" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.813102] env[66123]: INFO networking_nsxv3.common.synchronization [req-ddbf3f00-c424-48cb-ae5d-f139fce7fe5c req-ab8995c1-cee8-4b4d-802f-901d42c11498 tempest-SecurityGroupRulesTestJSON-2134659234 tempest-SecurityGroupRulesTestJSON-2134659234-project-member] Enqueued Resource ID: 0802bdda-399e-45f2-b28c-fa53fd39c114 with Priority: HIGHEST for action security_group_rules [ 956.813102] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0802bdda-399e-45f2-b28c-fa53fd39c114 with Priority: HIGHEST for action security_group_rules [ 956.814744] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0802bdda-399e-45f2-b28c-fa53fd39c114 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.814744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0802bdda-399e-45f2-b28c-fa53fd39c114" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.814744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0802bdda-399e-45f2-b28c-fa53fd39c114" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.814744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0802bdda-399e-45f2-b28c-fa53fd39c114" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.814744] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0802bdda-399e-45f2-b28c-fa53fd39c114',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.339357] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.340655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.340655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.340655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.340655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.340655] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0802bdda-399e-45f2-b28c-fa53fd39c114 already deleted. [ 957.340655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0802bdda-399e-45f2-b28c-fa53fd39c114" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.347935] env[66123]: INFO networking_nsxv3.common.synchronization [req-60816b38-7fe6-4db2-af43-c0705ced54ed req-7dc6a2c7-dc3c-4620-a8a7-fc3b26287a90 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 958.347935] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 958.347935] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.347935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.347935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.348894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.349162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.349348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.349780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.349780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.349780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.350025] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.562554] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7ac08118-ed2c-42ae-9f82-792b020bfebb None None] Enqueued Resource ID: 564c5242-36ea-482c-8703-409c507a3f7c with Priority: HIGHEST for action port [ 958.562554] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 564c5242-36ea-482c-8703-409c507a3f7c with Priority: HIGHEST for action port [ 958.562795] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-564c5242-36ea-482c-8703-409c507a3f7c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.562945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-564c5242-36ea-482c-8703-409c507a3f7c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.562987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-564c5242-36ea-482c-8703-409c507a3f7c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.563954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-564c5242-36ea-482c-8703-409c507a3f7c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.564240] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('564c5242-36ea-482c-8703-409c507a3f7c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.852805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.854095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.854095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.854095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.854095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.854521] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.854521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.854521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.854692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.854692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.854961] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a already deleted. [ 958.854961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.066754] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 564c5242-36ea-482c-8703-409c507a3f7c [ 959.066992] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.067156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.067464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.067464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.067860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.067860] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:564c5242-36ea-482c-8703-409c507a3f7c already deleted. [ 959.067860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-564c5242-36ea-482c-8703-409c507a3f7c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.395840] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.396200] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.396200] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.397203] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.397203] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.397203] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.397203] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.397203] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.397463] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.397631] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.397631] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.397733] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.397835] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.397957] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.398072] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.398201] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.421646] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.421646] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.421646] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.421646] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.421865] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-e8ea64aa-1451-4e91-8903-edf98fa9153d taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.421865] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.421988] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.422352] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.422494] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8ea64aa-1451-4e91-8903-edf98fa9153d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.925365] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.925507] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.925700] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.926065] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.926244] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.926397] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port e8ea64aa-1451-4e91-8903-edf98fa9153d not found, creating... [ 959.929083] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.929208] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.929335] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.929587] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.929726] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.930045] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.930204] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.930314] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.930521] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.930644] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.930778] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: e8ea64aa-1451-4e91-8903-edf98fa9153d is going to be created. [ 959.954224] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.954224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.954224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.954224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.954224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.954224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.068082] env[66123]: INFO networking_nsxv3.common.synchronization [None req-fee6d028-ce21-427c-ae01-a84625cfd5ca None None] Enqueued Resource ID: fb65fefc-fed7-47b4-be77-b780bb976a59 with Priority: HIGHEST for action port [ 960.068082] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb65fefc-fed7-47b4-be77-b780bb976a59 with Priority: HIGHEST for action port [ 960.068082] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb65fefc-fed7-47b4-be77-b780bb976a59 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.068464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb65fefc-fed7-47b4-be77-b780bb976a59" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.068609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb65fefc-fed7-47b4-be77-b780bb976a59" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.068936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb65fefc-fed7-47b4-be77-b780bb976a59" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.069339] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb65fefc-fed7-47b4-be77-b780bb976a59',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.199816] env[66123]: INFO networking_nsxv3.common.synchronization [req-a4c15b04-9054-47d9-8f84-19c8fbf01f1e req-2cf40415-4842-47c6-b724-c901cc9f8f7a tempest-ListImageFiltersTestJSON-1076943688 tempest-ListImageFiltersTestJSON-1076943688-project-member] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 960.201027] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGHEST for action security_group_members [ 960.201027] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.202135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.202361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.202665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.202916] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.203111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.203229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.203474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.203590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.203717] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.507678] env[66123]: INFO networking_nsxv3.common.synchronization [None req-4103f359-d53e-40d6-a32a-91217b38e524 None None] Enqueued Resource ID: e8f2515a-7403-46a8-9d3d-dcb2642a1619 with Priority: HIGHEST for action port [ 960.508725] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f2515a-7403-46a8-9d3d-dcb2642a1619 with Priority: HIGHEST for action port [ 960.509263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8f2515a-7403-46a8-9d3d-dcb2642a1619 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.509476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8f2515a-7403-46a8-9d3d-dcb2642a1619" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.509604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8f2515a-7403-46a8-9d3d-dcb2642a1619" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.509988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8f2515a-7403-46a8-9d3d-dcb2642a1619" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.510144] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8f2515a-7403-46a8-9d3d-dcb2642a1619',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.572635] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb65fefc-fed7-47b4-be77-b780bb976a59 [ 960.572877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.573041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.573259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.573374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.573406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.573938] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb65fefc-fed7-47b4-be77-b780bb976a59 already deleted. [ 960.573938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb65fefc-fed7-47b4-be77-b780bb976a59" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.699309] env[66123]: INFO networking_nsxv3.common.synchronization [req-60816b38-7fe6-4db2-af43-c0705ced54ed req-b8a6f80c-4895-4281-8356-eff6f49eed4a service nova] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 960.699309] env[66123]: INFO networking_nsxv3.common.synchronization [req-60816b38-7fe6-4db2-af43-c0705ced54ed req-b8a6f80c-4895-4281-8356-eff6f49eed4a service nova] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 960.699309] env[66123]: INFO networking_nsxv3.common.synchronization [req-60816b38-7fe6-4db2-af43-c0705ced54ed req-b8a6f80c-4895-4281-8356-eff6f49eed4a service nova] Enqueued Resource ID: e8ea64aa-1451-4e91-8903-edf98fa9153d with Priority: HIGHEST for action port [ 960.699309] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 960.699309] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 960.699684] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ea64aa-1451-4e91-8903-edf98fa9153d with Priority: HIGHEST for action port [ 960.700078] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.700334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.700543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.700816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.700978] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.702039] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.702277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.702415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.702652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.702877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.703124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.703257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.703469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.703626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.703886] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.704761] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8ea64aa-1451-4e91-8903-edf98fa9153d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.705380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.705526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.705741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.706185] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8ea64aa-1451-4e91-8903-edf98fa9153d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.709623] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.710805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.710805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.710805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.737202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.737423] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.737552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.737625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.738101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.738101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.738101] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be updated. [ 960.773254] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.773254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.773254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.773254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.773254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.781916] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: IN_PROGRESS for 2s [ 961.013561] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8f2515a-7403-46a8-9d3d-dcb2642a1619 [ 961.013561] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.013561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.013734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.013809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.013892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.014036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8f2515a-7403-46a8-9d3d-dcb2642a1619 already deleted. [ 961.014160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8f2515a-7403-46a8-9d3d-dcb2642a1619" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.201946] env[66123]: INFO networking_nsxv3.common.synchronization [req-170cd307-70e2-4042-8f32-092506daa402 req-670fcd4e-6b20-4477-afcc-bfe386bf286b tempest-SecurityGroupRulesTestJSON-2134659234 tempest-SecurityGroupRulesTestJSON-2134659234-project-member] Enqueued Resource ID: d7406f6c-e769-4dd2-b681-0ac5c98c6851 with Priority: HIGHEST for action security_group_rules [ 961.201946] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7406f6c-e769-4dd2-b681-0ac5c98c6851 with Priority: HIGHEST for action security_group_rules [ 961.202278] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7406f6c-e769-4dd2-b681-0ac5c98c6851 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.202397] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7406f6c-e769-4dd2-b681-0ac5c98c6851" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.202466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7406f6c-e769-4dd2-b681-0ac5c98c6851" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.202717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7406f6c-e769-4dd2-b681-0ac5c98c6851" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.202810] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7406f6c-e769-4dd2-b681-0ac5c98c6851',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.209266] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8ea64aa-1451-4e91-8903-edf98fa9153d with status ACTIVE [ 961.209344] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.209410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.209474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.209748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.209748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.209920] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.210120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.210120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.210289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.210369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.210538] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.210648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.210683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.210831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.210904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.210988] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8ea64aa-1451-4e91-8903-edf98fa9153d is going to be updated. [ 961.212169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.212263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.212575] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.234620] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.234758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.234827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.235139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.235276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.235438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8ea64aa-1451-4e91-8903-edf98fa9153d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.717511] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.725427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.725576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.725619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.725824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.726712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.726712] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7406f6c-e769-4dd2-b681-0ac5c98c6851 already deleted. [ 961.726712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7406f6c-e769-4dd2-b681-0ac5c98c6851" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.220412] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.220557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.220626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.220839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.220924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.221033] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be created. [ 962.250503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.250709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.250709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.251297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.251297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.261848] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: UNINITIALIZED for 2s [ 962.791268] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 in Status: SUCCESS [ 962.791651] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 deletion is rescheduled due to dependency. [ 962.791651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.477156] env[66123]: INFO networking_nsxv3.common.synchronization [req-52d56d5d-cfd2-457c-8e6d-fff393a4721a req-220f516b-735a-4254-930c-bc49c4d777b5 tempest-SecurityGroupRulesTestJSON-2134659234 tempest-SecurityGroupRulesTestJSON-2134659234-project-member] Enqueued Resource ID: bd682b0b-058d-4e84-af36-f5462f2745a6 with Priority: HIGHEST for action security_group_rules [ 963.477668] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd682b0b-058d-4e84-af36-f5462f2745a6 with Priority: HIGHEST for action security_group_rules [ 963.477990] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd682b0b-058d-4e84-af36-f5462f2745a6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.479260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd682b0b-058d-4e84-af36-f5462f2745a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.479260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd682b0b-058d-4e84-af36-f5462f2745a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.479260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd682b0b-058d-4e84-af36-f5462f2745a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.479260] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd682b0b-058d-4e84-af36-f5462f2745a6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.999925] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.000581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.000581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.001239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.001239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.001489] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd682b0b-058d-4e84-af36-f5462f2745a6 already deleted. [ 964.001709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd682b0b-058d-4e84-af36-f5462f2745a6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.281113] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 964.281380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.281561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.281795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.282077] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.282222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.282291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.282457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.282538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.282654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.282754] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.785602] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.016791] env[66123]: INFO networking_nsxv3.common.synchronization [req-9ba1e841-7bb3-4aae-b3d8-a71a5f5ed38e req-6a690f40-63b3-4b08-a41a-2b6e79c097cf tempest-SecurityGroupRulesTestJSON-2134659234 tempest-SecurityGroupRulesTestJSON-2134659234-project-member] Enqueued Resource ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 with Priority: HIGHEST for action security_group_rules [ 965.017371] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 with Priority: HIGHEST for action security_group_rules [ 965.017682] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ee299c2-68d5-478d-b256-6d55466d6f16 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.017832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.018369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.018369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.018369] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ee299c2-68d5-478d-b256-6d55466d6f16',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.287885] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76bf622f-13b1-4d60-b853-8d93458e789a: rpc.has_security_group_logging(os_id): False [ 965.307351] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.307351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.307351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.307565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.307565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.307788] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.307883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.307951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.308145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.308223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.308312] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be created. [ 965.313121] env[66123]: INFO networking_nsxv3.common.synchronization [req-08578183-1f62-46e5-b69f-13f5406dfd68 req-ac6ffa44-3dbf-4da8-a413-3c95a352bbcc tempest-SecurityGroupRulesTestJSON-2134659234 tempest-SecurityGroupRulesTestJSON-2134659234-project-member] Enqueued Resource ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 with Priority: HIGHEST for action security_group_rules [ 965.313656] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 with Priority: HIGHEST for action security_group_rules [ 965.314051] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ee299c2-68d5-478d-b256-6d55466d6f16 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.314166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.382676] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.383292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.383292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.383748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.383748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.396252] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 965.539333] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.539479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.539550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.541249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.541377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.541488] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 already deleted. [ 965.541578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.542152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.542382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.542465] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ee299c2-68d5-478d-b256-6d55466d6f16',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.063881] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.064312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.064312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.064390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.064451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.064551] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 already deleted. [ 966.064638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.259401] env[66123]: INFO networking_nsxv3.common.synchronization [req-823ff78b-5e8b-48b8-adbe-acd0a2e75d63 req-27784eed-6748-4d33-bdc4-8aad2ae1fa0d tempest-SecurityGroupRulesTestJSON-2134659234 tempest-SecurityGroupRulesTestJSON-2134659234-project-member] Enqueued Resource ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 with Priority: HIGHEST for action security_group_rules [ 966.262655] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 with Priority: HIGHEST for action security_group_rules [ 966.262655] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ee299c2-68d5-478d-b256-6d55466d6f16 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.262655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.262655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.262655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.262655] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ee299c2-68d5-478d-b256-6d55466d6f16',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.739090] env[66123]: INFO networking_nsxv3.common.synchronization [req-d06988e9-e805-4c84-9ed7-201b438adae6 req-80168450-6f35-4df2-9659-137ca307a06b tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 966.739696] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 966.740431] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.740431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.743300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.743547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.743716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.743933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.743933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.744115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.744115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.744223] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.786384] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.786569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.786629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.787027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.787027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.787027] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ee299c2-68d5-478d-b256-6d55466d6f16 already deleted. [ 966.787264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ee299c2-68d5-478d-b256-6d55466d6f16" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.232036] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.232332] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.232368] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.232605] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.232857] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.233014] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.233226] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.233449] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.233595] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.233916] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.234054] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.234166] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.234276] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.234388] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.234502] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.234689] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.249744] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.249889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.249960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.250233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.250344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.250542] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.250660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.250718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.250927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.251012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.251106] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 967.259466] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.259646] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.259786] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.259979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.260360] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.260557] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.260682] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.261044] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.261194] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.283937] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.284088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.284134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.284363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.285148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.295564] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 967.413809] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 967.414172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.765550] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.765823] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.765994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.766349] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.766517] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.766705] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc not found, creating... [ 967.767115] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.767227] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.767416] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.767688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.767847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.768312] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.768511] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.768658] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.768896] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.769054] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.769203] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc is going to be created. [ 967.794439] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.794744] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.794893] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.795148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.795412] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.795666] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.539323] env[66123]: INFO networking_nsxv3.common.synchronization [req-d06988e9-e805-4c84-9ed7-201b438adae6 req-ac402f63-d43c-4ff8-96ce-a33157020172 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 968.539614] env[66123]: INFO networking_nsxv3.common.synchronization [req-d06988e9-e805-4c84-9ed7-201b438adae6 req-ac402f63-d43c-4ff8-96ce-a33157020172 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 968.539663] env[66123]: INFO networking_nsxv3.common.synchronization [req-d06988e9-e805-4c84-9ed7-201b438adae6 req-ac402f63-d43c-4ff8-96ce-a33157020172 service nova] Enqueued Resource ID: f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc with Priority: HIGHEST for action port [ 968.541300] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 968.541300] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 968.541300] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc with Priority: HIGHEST for action port [ 968.541300] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.541300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.541300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.542251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.543456] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.545056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.545056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.545056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.545056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.545056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.545343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.545343] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.047673] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.047827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.048039] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc with status ACTIVE [ 969.048273] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.048579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.048579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.048811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.048906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.049099] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.049206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.049259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.049565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.049565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.049834] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.049995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.050118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.050332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.050441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.050583] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc is going to be updated. [ 969.072964] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.073318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.073318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.073466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.073871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.073871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8cc4b78-fbdd-408e-9e0d-d61e8232fbcc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.305781] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 969.305975] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 deletion is rescheduled due to dependency. [ 969.306106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.306280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.306501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.306687] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.306824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.306864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.307028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.307110] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.307209] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.812469] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.315233] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.816976] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.817272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.817272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.817507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.817609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.817715] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 970.856520] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.857396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.857396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.857849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.857849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.873897] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 971.247019] env[66123]: INFO networking_nsxv3.common.synchronization [req-83a12d3c-3627-4a58-b18c-8be55e240efb req-a36ea1be-21f1-4742-93f0-c8e734c62149 tempest-ServersV294TestFqdnHostnames-1740533811 tempest-ServersV294TestFqdnHostnames-1740533811-project-member] Enqueued Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_members [ 971.251773] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_members [ 971.252120] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f8a69fc-5713-4493-96dc-78b604a9517d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.252257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.252366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.252733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.252946] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.253121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.253263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.253391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.253486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.253602] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.605430] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.605627] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-229" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.605755] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-229" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.606349] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-229" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.606744] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.606999] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.607273] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.607600] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.607759] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.607996] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.608133] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.608255] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.608365] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.608475] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.608596] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.608732] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.629274] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.629503] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.629745] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.629997] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-229" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.630485] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-811b28ca-46c3-4e21-a7af-50bcbae507dc taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.630781] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.630929] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.631380] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.631776] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('811b28ca-46c3-4e21-a7af-50bcbae507dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.757531] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.758858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.758956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.759224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.759323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.759545] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.759656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.760300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.760300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.760300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.760300] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f8a69fc-5713-4493-96dc-78b604a9517d already deleted. [ 971.760300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.136381] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.137310] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.137563] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.138119] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.138371] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.138567] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 811b28ca-46c3-4e21-a7af-50bcbae507dc not found, creating... [ 972.139283] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.139470] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.139576] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.139826] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.139979] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.140315] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.140473] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.140588] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.140806] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.140939] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.141112] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 811b28ca-46c3-4e21-a7af-50bcbae507dc is going to be created. [ 972.176139] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.176519] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.176662] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.176900] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.177173] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.177421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.886331] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 972.886639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.886789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.887107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.887327] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.887472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.887540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.887716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.887807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.887898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.887992] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.977081] env[66123]: INFO networking_nsxv3.common.synchronization [req-83a12d3c-3627-4a58-b18c-8be55e240efb req-edb01951-2a3f-4aa6-ac61-02dc1c210982 service nova] Enqueued Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_rules [ 972.977418] env[66123]: INFO networking_nsxv3.common.synchronization [req-83a12d3c-3627-4a58-b18c-8be55e240efb req-edb01951-2a3f-4aa6-ac61-02dc1c210982 service nova] Enqueued Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_members [ 972.977654] env[66123]: INFO networking_nsxv3.common.synchronization [req-83a12d3c-3627-4a58-b18c-8be55e240efb req-edb01951-2a3f-4aa6-ac61-02dc1c210982 service nova] Enqueued Resource ID: 811b28ca-46c3-4e21-a7af-50bcbae507dc with Priority: HIGHEST for action port [ 972.978693] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_rules [ 972.978905] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_members [ 972.979172] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811b28ca-46c3-4e21-a7af-50bcbae507dc with Priority: HIGHEST for action port [ 972.979608] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f8a69fc-5713-4493-96dc-78b604a9517d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.979805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.979929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.980244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.980392] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.981588] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f8a69fc-5713-4493-96dc-78b604a9517d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.981800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.981918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.982023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.982205] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.982308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.982365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.982548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.982640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.982730] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.985136] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-811b28ca-46c3-4e21-a7af-50bcbae507dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.985296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.985409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.985656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.985785] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('811b28ca-46c3-4e21-a7af-50bcbae507dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.393017] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.393017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.393017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.393017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.393384] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.393776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.393905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.394141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.394902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.395094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.395315] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.396535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.396608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.396776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.397030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.397030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.397139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.397237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.397312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.397391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.397482] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.489127] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.489887] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f8a69fc-5713-4493-96dc-78b604a9517d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.490121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.490613] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 811b28ca-46c3-4e21-a7af-50bcbae507dc with status ACTIVE [ 973.490860] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.491057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.491672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.491974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.492207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.492648] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.493013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.493120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.493312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.493398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.493629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.493746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.493811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.493964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.494056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.494144] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 811b28ca-46c3-4e21-a7af-50bcbae507dc is going to be updated. [ 973.517610] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.517610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.517610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.517610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.517610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.517610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-811b28ca-46c3-4e21-a7af-50bcbae507dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.903033] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8: rpc.has_security_group_logging(os_id): False [ 973.925948] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.926211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.926900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.927242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.927294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.927897] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.927897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.927897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.927897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.929227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.929227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.929227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.929598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.929598] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 973.991888] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.994789] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.995058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.995240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.996846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.996846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.010706] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 974.274241] env[66123]: INFO networking_nsxv3.common.synchronization [req-89a468d8-cd43-4001-b450-af6c30daebb4 req-9791a17a-b1be-4d08-a645-55ffb8e2b3db tempest-ServersNegativeTestJSON-927005488 tempest-ServersNegativeTestJSON-927005488-project-member] Enqueued Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 974.274384] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c with Priority: HIGHEST for action security_group_members [ 974.275341] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.275571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.275648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.275857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.276077] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.276193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.276257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.276429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.276572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.276678] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.497730] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.498768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.498768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.498768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.498768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.498768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f8a69fc-5713-4493-96dc-78b604a9517d is going to be created. [ 974.524622] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.525349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.525349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.525349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.525349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.536023] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f8a69fc-5713-4493-96dc-78b604a9517d in Status: UNINITIALIZED for 2s [ 974.643655] env[66123]: INFO networking_nsxv3.common.synchronization [None req-904c0234-5e20-4360-90b3-f81408f74bf0 None None] Enqueued Resource ID: 82d00560-e9b4-4204-a1c8-eecac2a57003 with Priority: HIGHEST for action port [ 974.645201] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d00560-e9b4-4204-a1c8-eecac2a57003 with Priority: HIGHEST for action port [ 974.646189] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d6d5549d-2bf1-4246-8b0d-3b6cf5b3f04c tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 974.646572] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-82d00560-e9b4-4204-a1c8-eecac2a57003 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.646696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82d00560-e9b4-4204-a1c8-eecac2a57003" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.646765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82d00560-e9b4-4204-a1c8-eecac2a57003" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.647026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82d00560-e9b4-4204-a1c8-eecac2a57003" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.647109] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d00560-e9b4-4204-a1c8-eecac2a57003',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.650275] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 974.651220] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.651884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.653430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.653700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.654347] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.733393] env[66123]: INFO networking_nsxv3.common.synchronization [None req-3f731e5a-82b2-4ddd-9baf-cc46dc95e38c tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 974.736746] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 974.737375] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.737375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.782625] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.782901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.782979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.783239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.783339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.783551] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.783651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.783713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.783869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.783947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.784042] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c is going to be updated. [ 974.824687] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.824687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.824819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.825015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.825469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.999631] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: IN_PROGRESS for 2s [ 975.151770] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82d00560-e9b4-4204-a1c8-eecac2a57003 [ 975.152026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.152173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.152271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.152497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.152586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.152687] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82d00560-e9b4-4204-a1c8-eecac2a57003 already deleted. [ 975.152769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82d00560-e9b4-4204-a1c8-eecac2a57003" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.172071] env[66123]: INFO networking_nsxv3.common.synchronization [None req-0999e2e7-b6f4-4db5-8240-47bb4284787e tempest-ServersTestJSON-1133831859 tempest-ServersTestJSON-1133831859-project-member] Enqueued Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_rules [ 975.172833] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_rules [ 975.173028] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.173191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.173260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.173586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.173699] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.178395] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.178564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.178663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.178950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.179052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.179187] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 already deleted. [ 975.179308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.179856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.180128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.180247] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.325166] env[66123]: INFO networking_nsxv3.common.synchronization [None req-bbdeee56-d78c-4381-a6d8-b376bc6176a3 tempest-ServersTestJSON-1133831859 tempest-ServersTestJSON-1133831859-project-member] Enqueued Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_rules [ 975.326472] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_rules [ 975.328647] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.328647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.698162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.698162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.698162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.698162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.698162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.698162] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f already deleted. [ 975.698162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.698162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.698162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.698162] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.706096] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.706096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.706096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.706096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.706096] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 already deleted. [ 975.706096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.039618] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 976.039618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.220220] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.220370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.220445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.220660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.220745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.220861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f already deleted. [ 976.220954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.238395] env[66123]: INFO networking_nsxv3.common.synchronization [req-cdf629f2-df14-4ccd-9a62-7f2c126092b2 req-3ffd00cf-0222-48da-baf4-cb286f02d417 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 976.239502] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 976.240149] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.240149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.240372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.241162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.241413] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.241578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.241728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.242344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.242344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.242481] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.548027] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f8a69fc-5713-4493-96dc-78b604a9517d in Status: SUCCESS [ 976.548027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.548322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.548516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.550036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.550036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.550036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.550036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.550036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.550036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.550036] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.644456] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.644704] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.644859] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.645275] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.645547] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.645703] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.645874] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.646155] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.646356] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.646662] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.646796] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.650165] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.650165] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.650165] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.650319] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.650368] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.671616] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.671793] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.672470] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.672470] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.672470] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.672667] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.672703] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.674054] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.674054] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3144a5a1-b519-4fbb-93ee-5c5150f29dbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.744227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.744523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.744523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.744668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.744759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.744962] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.745182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.745264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.745507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.745655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.745772] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 already deleted. [ 976.745909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.017825] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c in Status: SUCCESS [ 977.017825] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c deletion is rescheduled due to dependency. [ 977.017825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.054335] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.176930] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.178011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.178011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.178011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.178011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.178011] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 3144a5a1-b519-4fbb-93ee-5c5150f29dbd not found, creating... [ 977.178307] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.178307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.178404] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.178619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.178736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.179037] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.179206] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.179351] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.179502] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.179632] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.179772] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd is going to be created. [ 977.205883] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.206887] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.206887] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.206887] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.206887] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.207088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.491044] env[66123]: INFO networking_nsxv3.common.synchronization [None req-17845427-a279-488c-8f4c-f415f3e95a9c None None] Enqueued Resource ID: 5d24119b-62ca-4632-a504-f9bfe00b026e with Priority: HIGHEST for action port [ 977.491883] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d24119b-62ca-4632-a504-f9bfe00b026e with Priority: HIGHEST for action port [ 977.492311] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d24119b-62ca-4632-a504-f9bfe00b026e taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.492458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d24119b-62ca-4632-a504-f9bfe00b026e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.492531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d24119b-62ca-4632-a504-f9bfe00b026e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.493012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d24119b-62ca-4632-a504-f9bfe00b026e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.493180] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d24119b-62ca-4632-a504-f9bfe00b026e',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.556174] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f8a69fc-5713-4493-96dc-78b604a9517d: rpc.has_security_group_logging(os_id): False [ 977.578192] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.578365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.578489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.578634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.578710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.578983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.579094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.579165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.579312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.579386] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.579476] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f8a69fc-5713-4493-96dc-78b604a9517d is going to be created. [ 977.654025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.654232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.654277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.654576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.656537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.667460] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f8a69fc-5713-4493-96dc-78b604a9517d in Status: IN_PROGRESS for 2s [ 977.995278] env[66123]: INFO networking_nsxv3.common.synchronization [req-cdf629f2-df14-4ccd-9a62-7f2c126092b2 req-8e475a3a-c530-4ca6-9d86-e258a0931747 service nova] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 977.995525] env[66123]: INFO networking_nsxv3.common.synchronization [req-cdf629f2-df14-4ccd-9a62-7f2c126092b2 req-8e475a3a-c530-4ca6-9d86-e258a0931747 service nova] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 977.995671] env[66123]: INFO networking_nsxv3.common.synchronization [req-cdf629f2-df14-4ccd-9a62-7f2c126092b2 req-8e475a3a-c530-4ca6-9d86-e258a0931747 service nova] Enqueued Resource ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with Priority: HIGHEST for action port [ 977.996031] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d24119b-62ca-4632-a504-f9bfe00b026e [ 977.996265] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.996452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.996555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.996846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.996998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.997075] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d24119b-62ca-4632-a504-f9bfe00b026e already deleted. [ 977.997162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d24119b-62ca-4632-a504-f9bfe00b026e" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.997602] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 977.997731] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 977.997826] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with Priority: HIGHEST for action port [ 977.998115] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.998351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.998439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.998677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.000987] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.000987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.000987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.000987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.000987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.000987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.000987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.000987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.000987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.000987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.000987] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.001885] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.002358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.002716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.002913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.003017] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3144a5a1-b519-4fbb-93ee-5c5150f29dbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.506235] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with status ACTIVE [ 978.506472] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.506604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.506671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.506881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.506971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.507168] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.507258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.507316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.507468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.507542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.507722] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.507813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.507872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.508020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.508092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.508174] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd is going to be updated. [ 978.511534] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.511534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.511947] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.533679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.535137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.535246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.535470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.535616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.535786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.014857] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.517427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.517427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.517427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.517681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.517791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.517901] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be created. [ 979.544061] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.544188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.544188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.546182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.546182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.555166] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: UNINITIALIZED for 2s [ 979.684643] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f8a69fc-5713-4493-96dc-78b604a9517d in Status: SUCCESS [ 979.684881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.463102] env[66123]: INFO networking_nsxv3.common.synchronization [req-4ede06b6-4ca8-4113-a23c-ed8c941aab5b req-f9b8f40a-ff6b-489b-902e-ac38d86598d9 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 980.463761] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 980.464147] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.464269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.464402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.464597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.464762] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.464866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.464951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.465190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.465294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.465403] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.968101] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.968305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.968348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.968630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.968758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.968997] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.969119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.969231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.969422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.969542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.969659] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 981.046510] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.046696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.046738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.047622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.047622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058233] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 981.567129] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 981.567662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.567662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.567867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.568014] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.568166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.568230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.568431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.568550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.568590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.568794] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.075090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.075090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.075090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.075090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.075090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.075764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.075764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.075878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.076136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.076360] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.579646] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fb7a681-0823-49de-9892-747a25a5f324: rpc.has_security_group_logging(os_id): False [ 982.617540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.617540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.617540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.617540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.618242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.618242] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.618242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.618242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.618242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.618420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.618450] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.618668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.618668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.618886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.618886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.618991] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.619092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.619195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.619291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.619363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.619506] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be created. [ 982.706179] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.706179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.706179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.706424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.706424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.719387] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 983.070316] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 983.070531] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 983.070531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.689700] env[66123]: INFO networking_nsxv3.common.synchronization [req-3a81b9fe-b2de-4b91-b0a8-71b7cd4dc60a req-e410d46a-eebd-4826-85f4-cb5dd54ee815 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 983.690254] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 983.690686] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.690686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.690827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.690989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.691536] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.691717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.691785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.691984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.692089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.692202] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.194998] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.195296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.195371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.195943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.196208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.196643] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.197071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.197071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.197208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.197325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.197496] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 984.230900] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.231155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.231155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.231325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.231476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.241747] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 984.731636] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 984.731945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.599358] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-71f0dadd-34d5-4fbf-bd8a-116aad8ef82a tempest-ListServersNegativeTestJSON-1592154545 tempest-ListServersNegativeTestJSON-1592154545-project-member] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 985.600316] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 985.600627] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.600924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.600924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.601082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.601248] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.601346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.601406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.601560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.601642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.601732] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.027053] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-933 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.027053] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.027053] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.027053] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.027053] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.027528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.027528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.027722] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.027876] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.028133] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.028616] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.028745] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.028892] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.029022] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.029133] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.029272] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.051984] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.052327] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.052442] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.052704] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.053166] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-5dd460df-0da3-484e-8bee-ce6724a0142b taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.053496] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.053688] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.054058] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.054342] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dd460df-0da3-484e-8bee-ce6724a0142b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.104090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.104270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.104379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.104576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.104661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.104866] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.104963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.105035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.105353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.105436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.105778] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 already deleted. [ 986.105778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.251886] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 986.252607] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 986.252607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.557721] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.557721] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.557721] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.558112] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.558112] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.558374] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 5dd460df-0da3-484e-8bee-ce6724a0142b not found, creating... [ 986.558734] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.558968] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.559174] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.559474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.559753] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.560097] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.560326] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.560499] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.560766] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.560954] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.561167] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 5dd460df-0da3-484e-8bee-ce6724a0142b is going to be created. [ 986.581783] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.581783] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.581783] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.582130] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.582364] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.582602] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.432334] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-123a999a-2c02-4f0e-9123-f3f97d320c43 service nova] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_rules [ 987.433254] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-123a999a-2c02-4f0e-9123-f3f97d320c43 service nova] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 987.433254] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-123a999a-2c02-4f0e-9123-f3f97d320c43 service nova] Enqueued Resource ID: 5dd460df-0da3-484e-8bee-ce6724a0142b with Priority: HIGHEST for action port [ 987.434038] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_rules [ 987.434038] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 987.434038] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd460df-0da3-484e-8bee-ce6724a0142b with Priority: HIGHEST for action port [ 987.434770] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.435069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.435069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.435375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.435961] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.441469] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.441469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.441469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.441783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.441912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.442021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.442089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.442254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.442334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.442437] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.443540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dd460df-0da3-484e-8bee-ce6724a0142b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.443686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.443736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.443998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.443998] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dd460df-0da3-484e-8bee-ce6724a0142b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.947668] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.947884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.948197] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.949717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dd460df-0da3-484e-8bee-ce6724a0142b with status ACTIVE [ 987.950023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.950210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.950326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.950622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.950755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.951042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.951286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.951394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.952894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.952894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.952894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.952894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.952894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.952894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.952894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.952894] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dd460df-0da3-484e-8bee-ce6724a0142b is going to be updated. [ 987.981437] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.981688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.981787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.982148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.982347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.982583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dd460df-0da3-484e-8bee-ce6724a0142b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.214828] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-a2c668d5-9a76-4a42-8965-1c099a77e51a tempest-ListServersNegativeTestJSON-1592154545 tempest-ListServersNegativeTestJSON-1592154545-project-member] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 988.215456] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 988.215757] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.215899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.456120] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.609917] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-933 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.610127] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.610265] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.610535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.610801] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.610988] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.611167] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.611391] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.611535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.611765] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.611875] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.611992] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.612109] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.612215] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.612317] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.612457] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.632872] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.633248] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 988.633411] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.633594] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.633992] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-46346b36-b2dc-4156-b229-67fa44f9acdb taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.634208] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.634342] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.634708] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.634867] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46346b36-b2dc-4156-b229-67fa44f9acdb',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.793518] env[66123]: INFO networking_nsxv3.common.synchronization [req-b641d7cd-8506-446d-8929-984898696e60 req-6eae9358-ce09-40f3-968f-d1851ebdd3b2 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 988.793722] env[66123]: INFO networking_nsxv3.common.synchronization [req-b641d7cd-8506-446d-8929-984898696e60 req-6eae9358-ce09-40f3-968f-d1851ebdd3b2 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 988.794450] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 988.794662] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 988.794970] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.795134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.795198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.795438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.795633] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.795842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.795909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.796130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.796264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.796375] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.797461] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.797584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.797676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.797965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.798200] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.798345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.798433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.798610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.798700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.798810] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.848012] env[66123]: INFO networking_nsxv3.common.synchronization [req-b641d7cd-8506-446d-8929-984898696e60 req-6eae9358-ce09-40f3-968f-d1851ebdd3b2 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_rules [ 988.848667] env[66123]: INFO networking_nsxv3.common.synchronization [req-b641d7cd-8506-446d-8929-984898696e60 req-6eae9358-ce09-40f3-968f-d1851ebdd3b2 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 988.850270] env[66123]: INFO networking_nsxv3.common.synchronization [req-b641d7cd-8506-446d-8929-984898696e60 req-6eae9358-ce09-40f3-968f-d1851ebdd3b2 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 988.850451] env[66123]: INFO networking_nsxv3.common.synchronization [req-b641d7cd-8506-446d-8929-984898696e60 req-6eae9358-ce09-40f3-968f-d1851ebdd3b2 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 988.850697] env[66123]: INFO networking_nsxv3.common.synchronization [req-b641d7cd-8506-446d-8929-984898696e60 req-6eae9358-ce09-40f3-968f-d1851ebdd3b2 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with Priority: HIGHEST for action port [ 988.851615] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_rules [ 988.851806] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 988.851903] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with Priority: HIGHEST for action port [ 988.851998] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 988.852435] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 988.852817] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.852962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.856711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.857666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.857666] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.861273] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.861273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.861273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.861273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.861273] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.861273] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.862371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.862371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.862742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.862742] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3144a5a1-b519-4fbb-93ee-5c5150f29dbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.865347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.865347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.865347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.865347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.958631] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.958882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.958932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.959222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.959343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.959477] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be created. [ 988.989947] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.990242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.990242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.990420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.990650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.001739] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: UNINITIALIZED for 2s [ 989.138061] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.138061] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.138061] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.138061] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.138404] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.138404] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 46346b36-b2dc-4156-b229-67fa44f9acdb not found, creating... [ 989.138613] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.138766] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.138878] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.139122] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.139262] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.139546] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.139698] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.139812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.140032] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.140169] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.140310] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 46346b36-b2dc-4156-b229-67fa44f9acdb is going to be created. [ 989.164722] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.165044] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.165152] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.165520] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.165838] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.166190] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.301403] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.302436] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.366271] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with status ACTIVE [ 989.366647] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.366844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.366929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.367159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.367254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.367553] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.367680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.367757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.367918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.368230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.368274] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.368397] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.368467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.368580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.368650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.368742] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd is going to be updated. [ 989.370389] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.370503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.370719] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.370816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.395658] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.395846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.395885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.396145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.396306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.396475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.649688] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 989.650143] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_members [ 989.650143] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 989.650564] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 989.650622] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_members [ 989.650709] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 989.651015] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.651109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.651321] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.651400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.651459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.651671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.651821] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.651921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.651981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.652141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.652226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.652317] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.653228] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.653304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.697830] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_rules [ 989.698013] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 989.698156] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 989.698287] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 989.698411] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_rules [ 989.698534] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_members [ 989.698657] env[66123]: INFO networking_nsxv3.common.synchronization [req-029bd8ab-83b7-4afd-8c93-3d73b6c6f5a0 req-7bebfe10-e596-4e12-960f-fc5d340a7454 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with Priority: HIGHEST for action port [ 989.699268] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_rules [ 989.699755] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 989.699804] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_members [ 989.699898] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with Priority: HIGHEST for action port [ 989.700048] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_rules [ 989.700089] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 989.700172] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 989.700461] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.700563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.700759] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.700841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.701030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.701289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.701501] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.701635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.701704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.701905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.701990] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3144a5a1-b519-4fbb-93ee-5c5150f29dbd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.703040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.703159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.703159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.703395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.703505] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.704480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.704577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.704805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.704936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.806058] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.807455] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.892572] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-2101e897-ff2c-46d0-9fcc-c92de27d1526 service nova] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_rules [ 989.892764] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-2101e897-ff2c-46d0-9fcc-c92de27d1526 service nova] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 989.892932] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-2101e897-ff2c-46d0-9fcc-c92de27d1526 service nova] Enqueued Resource ID: 46346b36-b2dc-4156-b229-67fa44f9acdb with Priority: HIGHEST for action port [ 989.893992] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_rules [ 989.894550] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 989.894692] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46346b36-b2dc-4156-b229-67fa44f9acdb with Priority: HIGHEST for action port [ 989.894956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.897018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.897018] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.897018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.897548] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-46346b36-b2dc-4156-b229-67fa44f9acdb taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.897645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.897713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.897927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.898023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46346b36-b2dc-4156-b229-67fa44f9acdb',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.154930] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.206672] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3144a5a1-b519-4fbb-93ee-5c5150f29dbd with status ACTIVE [ 990.206952] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.210777] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.210777] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.210777] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3144a5a1-b519-4fbb-93ee-5c5150f29dbd is going to be updated. [ 990.210777] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.210777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.236418] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.236603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.236736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.236957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.237127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.237310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3144a5a1-b519-4fbb-93ee-5c5150f29dbd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.311964] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.312172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.312820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.312820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.312820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.312820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 990.314154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.314272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.314340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.314519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.314601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.314690] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be created. [ 990.340804] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.341476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.341476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.341476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.341476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.356947] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.357203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.357440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.357546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.365127] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: UNINITIALIZED for 2s [ 990.369332] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 990.402271] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46346b36-b2dc-4156-b229-67fa44f9acdb with status ACTIVE [ 990.402463] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.402620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.402707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.403304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.403304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.403304] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.403473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.403473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.403645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.403739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.403940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.404070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.404134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.404292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.404371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.404455] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46346b36-b2dc-4156-b229-67fa44f9acdb is going to be updated. [ 990.442899] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.442899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.442899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.443124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.445272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.445272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46346b36-b2dc-4156-b229-67fa44f9acdb" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.658878] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.707604] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-79e84f4b-580e-45cb-a898-780d21dc5e47 tempest-ListServersNegativeTestJSON-1592154545 tempest-ListServersNegativeTestJSON-1592154545-project-member] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 990.708282] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 990.708619] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.708727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.015393] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 991.015624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.015807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.016054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.016260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.016379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.016443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.016632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.016715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.016919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.016919] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.025334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.025334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.025334] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.025334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.026092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.026092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.026092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.026092] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.129520] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-933 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.129745] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.129874] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.130199] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.130491] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.130663] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.130781] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.131845] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.132175] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.132529] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.132718] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.134950] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.134950] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.134950] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.134950] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.135263] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.157795] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.157967] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.158132] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.159121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-933" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.159483] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.160031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.160232] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.160626] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.160751] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('124db48d-2b3b-4e8e-9ff1-7e8dc895b13f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.161917] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.162127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.162127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.162346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.162448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.162531] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 is going to be created. [ 991.190607] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.190607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.190607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.190607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.190949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.206710] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: UNINITIALIZED for 2s [ 991.525381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.525381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.529674] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.665212] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.665601] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.665601] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.665904] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.666066] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.666232] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 124db48d-2b3b-4e8e-9ff1-7e8dc895b13f not found, creating... [ 991.666490] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.666647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.666763] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.666977] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.667133] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.667407] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.667562] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.667676] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.667884] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.668027] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.668171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 124db48d-2b3b-4e8e-9ff1-7e8dc895b13f is going to be created. [ 991.689338] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.689567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.689705] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.689966] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.690224] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.690456] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.031645] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.380939] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 992.381380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.381619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.382189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.382429] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.382581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.382669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.382904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.383066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.383242] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.388827] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 992.388827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.388827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.388827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.388827] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.388827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.388827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.388827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.388827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.388827] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.438423] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-37828bb2-6b2a-41b3-bf7e-468b2cfaaf1a service nova] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_rules [ 992.438612] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-37828bb2-6b2a-41b3-bf7e-468b2cfaaf1a service nova] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 992.438744] env[66123]: INFO networking_nsxv3.common.synchronization [req-db7fbab9-54d5-4403-8c90-b12030297b34 req-37828bb2-6b2a-41b3-bf7e-468b2cfaaf1a service nova] Enqueued Resource ID: 124db48d-2b3b-4e8e-9ff1-7e8dc895b13f with Priority: HIGHEST for action port [ 992.442951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_rules [ 992.442951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 992.442951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124db48d-2b3b-4e8e-9ff1-7e8dc895b13f with Priority: HIGHEST for action port [ 992.442951] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.442951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.442951] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.442951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.442951] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.442951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.442951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.443729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.443729] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('124db48d-2b3b-4e8e-9ff1-7e8dc895b13f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.534983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.537758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.537758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.537758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.537758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.537758] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 992.568824] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.568824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.568824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.568824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.568824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.577975] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 992.892075] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.892509] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.946264] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 124db48d-2b3b-4e8e-9ff1-7e8dc895b13f with status ACTIVE [ 992.946506] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.946647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.946739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.946924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.947032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.947237] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.947339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.947400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.947555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.947630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.947805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.947893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.947953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.948096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.948167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.948249] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 124db48d-2b3b-4e8e-9ff1-7e8dc895b13f is going to be updated. [ 992.972913] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.973088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.973208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.973507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.973671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.973876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-124db48d-2b3b-4e8e-9ff1-7e8dc895b13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.223317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: UNINITIALIZED for 4s [ 993.394195] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.395607] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.476770] env[66123]: INFO networking_nsxv3.common.synchronization [req-10b8f5b3-a3e6-4874-b211-6c7c3be92c36 req-a49f8344-9408-40bf-88fa-df8719a6b300 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 993.477715] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 993.478141] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.478289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.478528] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.480006] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.480006] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.480006] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.480006] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.480006] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.480006] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.480006] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.898036] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.898411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.898411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.898837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.898837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.898837] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 993.900211] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.900602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.900672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.900868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.900951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.901189] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be updated. [ 993.934950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.935251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.935322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.935580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.935786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.938404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.938540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.939034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.939034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.939172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.950812] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 993.951811] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: IN_PROGRESS for 2s [ 993.973629] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.973839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.973965] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.974271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.974538] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.974697] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.974812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.975209] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.975455] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.975719] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.975853] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.975984] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.976147] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.976416] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.976545] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.976717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.985711] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.999843] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.000100] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.000349] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.000604] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.000985] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-0e796366-cb9f-4e37-ac16-521cedddfbe8 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.001378] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.001378] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.001736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.001880] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e796366-cb9f-4e37-ac16-521cedddfbe8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.485389] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.504607] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.504920] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.505148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.505491] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.505700] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.505935] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 0e796366-cb9f-4e37-ac16-521cedddfbe8 not found, creating... [ 994.506350] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.507206] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.507417] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.507754] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.507957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.508404] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.508629] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.508792] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.509132] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.509344] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.509543] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 0e796366-cb9f-4e37-ac16-521cedddfbe8 is going to be created. [ 994.533794] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.534147] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.534270] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.534620] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.534935] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.535337] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.596492] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 994.596870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.597153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.597472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.597754] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.597932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.598077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.598330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.598454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.598698] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.990048] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.990048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.990048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.990425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.990425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.990425] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 995.022263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.022781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.023037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.023462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.024553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.034347] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 995.101176] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.240083] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: SUCCESS [ 995.240306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.241025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.241025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.241025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.241025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.241224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.241224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.241298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.241355] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.310151] env[66123]: INFO networking_nsxv3.common.synchronization [req-10b8f5b3-a3e6-4874-b211-6c7c3be92c36 req-d0c4a78f-eab9-4178-8faf-0ad317f4cffe service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 995.310788] env[66123]: INFO networking_nsxv3.common.synchronization [req-10b8f5b3-a3e6-4874-b211-6c7c3be92c36 req-d0c4a78f-eab9-4178-8faf-0ad317f4cffe service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 995.310986] env[66123]: INFO networking_nsxv3.common.synchronization [req-10b8f5b3-a3e6-4874-b211-6c7c3be92c36 req-d0c4a78f-eab9-4178-8faf-0ad317f4cffe service nova] Enqueued Resource ID: 0e796366-cb9f-4e37-ac16-521cedddfbe8 with Priority: HIGHEST for action port [ 995.312067] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 995.312208] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 995.312310] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e796366-cb9f-4e37-ac16-521cedddfbe8 with Priority: HIGHEST for action port [ 995.312606] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.312723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.312811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.312991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.313086] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.317030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.317030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.317030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e796366-cb9f-4e37-ac16-521cedddfbe8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.317030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.317030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.317030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.317030] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e796366-cb9f-4e37-ac16-521cedddfbe8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.605523] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.660790] env[66123]: INFO networking_nsxv3.common.synchronization [None req-762afde3-2783-47a3-b332-a1de1c3a294e tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_rules [ 995.660790] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_rules [ 995.661506] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.661673] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.661745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.662251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.662408] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.745439] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.811589] env[66123]: INFO networking_nsxv3.common.synchronization [None req-bdd68bce-5ee1-46a4-9f0e-f6a53fc32980 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_rules [ 995.814500] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_rules [ 995.816679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.816819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.817179] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.817271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.819608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e796366-cb9f-4e37-ac16-521cedddfbe8 with status ACTIVE [ 995.819789] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.819907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.819975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.820193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.820284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.820468] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.820568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.820630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.820786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.820867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.821061] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.821156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.821221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.821361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.821435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.821556] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e796366-cb9f-4e37-ac16-521cedddfbe8 is going to be updated. [ 995.851634] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.851634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.851634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.851634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.851917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.851967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e796366-cb9f-4e37-ac16-521cedddfbe8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.964141] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 995.964309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.965256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.965256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.965256] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.965256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.965256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.966258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.966258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.966258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.966258] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.967454] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.970019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.970019] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.970019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.970019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.970642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.970642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.970642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.970642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.970642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.970642] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.971811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.971968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.972142] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.972244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.972301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.972438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.972516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.972617] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.109937] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.110246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.110246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.112029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.112029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.112029] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 996.141901] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.142137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.142240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.142501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.142693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.154096] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 996.189691] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.189691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.189691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.189691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.189691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.189691] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5028f4c-8816-49e2-a746-b352623465f8 already deleted. [ 996.189691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.189691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.190617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.190617] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.247764] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.473065] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.473226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.473434] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.474703] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.475430] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.712407] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.712828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.712971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.713227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.713325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.713426] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5028f4c-8816-49e2-a746-b352623465f8 already deleted. [ 996.713511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.750845] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.750845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.750845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.750845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.751121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.751121] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 is going to be updated. [ 996.781524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.781524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.781524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.781790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.781993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.792093] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: IN_PROGRESS for 2s [ 996.979839] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 290fd936-57e7-4c7e-9104-b187d1d91b09: rpc.has_security_group_logging(os_id): False [ 996.979839] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.979839] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.000407] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.000573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.000634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.003069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.003203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.003664] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.003758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.003794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.003986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.004169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.004295] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be created. [ 997.044904] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 997.045867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.046084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.046533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.046740] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.046885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.046954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.047153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.047240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.047372] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.106915] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.107084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.107158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.107392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.107576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.134075] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: IN_PROGRESS for 2s [ 997.481668] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.481919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.481957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.482181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.482271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.482439] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 997.484051] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.484198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.484283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.484489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.484574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.484668] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be updated. [ 997.552226] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.552226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.552226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.552439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.552791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.555743] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.556079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.558225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.558645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.558827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.560921] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.580159] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 997.581959] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: IN_PROGRESS for 2s [ 998.064043] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.165608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 998.166176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.166176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.166297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.166701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.166701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.166701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.167052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.167052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.167052] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.570285] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.570467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.570517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.570734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.570820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.570958] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 998.599510] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.599629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.599697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.599925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.600079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.610961] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 998.669788] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.802595] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: SUCCESS [ 998.802842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.803051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.803329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.803552] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.803694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.803778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.803967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.804071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.804163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.804265] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.148885] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 999.149309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.149527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.149804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.149957] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.172088] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.307039] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.592111] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 999.592349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.592487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.592720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.592900] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.593027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.593081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.593270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.593353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.593450] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.594878] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 999.595057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.595233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.595404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.595563] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.595662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.595726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.595860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.595935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.596029] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.652663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.652813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.674014] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.675250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.675250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.675250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.675250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.675250] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 999.707449] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.707663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.707743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.707976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.708151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.719465] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 999.811049] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de28cfe1-47d1-4e0d-9126-97eb3c037662: rpc.has_security_group_logging(os_id): False [ 999.829820] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.830058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.830196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.830524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.830645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.831015] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.831190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.831285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.831611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.831666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.831795] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 is going to be created. [ 999.886720] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.886895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.886956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.887170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.888163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.901736] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: IN_PROGRESS for 2s [ 1000.098035] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.099225] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.600721] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.603639] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.627994] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1000.628367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.628548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.628777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.628983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.629191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.629345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.629615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.629735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.629844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.629981] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.815677] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1000.815860] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=12 [ 1001.104617] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.105357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.105479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.105752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.105887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.106014] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1001.107843] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.108033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.108093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.108331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.108465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.108620] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be updated. [ 1001.135916] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.136121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.136121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.136320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.136513] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.136631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.136719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.136898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.137024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.137154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.137353] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.137498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.137498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.137712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.137865] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.138026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.138147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.138276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.138359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.138445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.138557] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.140708] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.140824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.140902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.141057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.141228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.143493] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.143604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.143688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.143853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.143985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.156293] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1001.157122] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: IN_PROGRESS for 2s [ 1001.644142] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 1001.662859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.663038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.663038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.664271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.664271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.664271] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.664271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.664271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.664271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.664271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.664592] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.664592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.664667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.664847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.664968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.665302] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.665380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.665444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.665629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.665824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.665824] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1001.742067] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1001.742377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.744159] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.744159] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.744159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.744733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.744733] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.744733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.744733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.744889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.744889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.744946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.745062] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.747193] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.747310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.747384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.747686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.747842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.748965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.749156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.749329] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.749434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.749499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.749640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.749715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.749836] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.772613] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1001.916748] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: SUCCESS [ 1001.916748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.251773] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6b25007-70eb-4a46-96cf-27a55632b2b5: rpc.has_security_group_logging(os_id): False [ 1002.253306] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.274749] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.274974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.275058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.275368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.275483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.275709] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.275828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.275921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.276182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.276270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.276475] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.276583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.276646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.276810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.276963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.277171] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.277271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.277348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.277493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.277582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.277667] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be created. [ 1002.401366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.401615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.401615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.402048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.402508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.419481] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 1002.755806] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.170078] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.170078] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.170078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.170078] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.170562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.170562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.170562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.170662] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.170662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.170740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.171728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.171728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.171728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.171728] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.172509] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 1003.172685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.172830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.172987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.173176] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.173281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.173345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.173487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.173562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.173646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.173753] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.259475] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.259475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.259475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.259475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.259475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.259475] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 1003.309760] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.309931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.310025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.310260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.310445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.327851] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 1003.678313] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fb7a681-0823-49de-9892-747a25a5f324: rpc.has_security_group_logging(os_id): False [ 1003.680376] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.700828] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.701071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.701071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.701273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.701349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.701583] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.701672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.701750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.701882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.701965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.702149] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.702241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.702317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.702475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.702552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.702706] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.702838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.702904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.703939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.704076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.704174] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1003.772264] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.772264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.772264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.772626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.772626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.789857] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1003.792734] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1003.792960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.174170] env[66123]: INFO networking_nsxv3.common.synchronization [req-04eda60e-cb27-4244-b0e2-f4978aff5f68 req-1a377202-d2ce-45fc-8465-dd2fd03942c5 tempest-ListServersNegativeTestJSON-1592154545 tempest-ListServersNegativeTestJSON-1592154545-project-member] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 1004.174739] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 1004.177283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.177423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.182959] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 290fd936-57e7-4c7e-9104-b187d1d91b09: rpc.has_security_group_logging(os_id): False [ 1004.205129] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.205247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.205301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.205502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.205593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.205973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.205973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.205973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.206136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.206300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.206300] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be updated. [ 1004.316463] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.316463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.316463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.316850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.316850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.331214] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: IN_PROGRESS for 2s [ 1004.435030] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1004.435362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.435950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.436218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.436763] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.696910] env[66123]: INFO networking_nsxv3.common.synchronization [req-64460a27-ff6a-4ab5-9b8b-2d14508c014d req-f18db695-d738-44a2-8113-090ce01d2fbb tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1004.697517] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1004.698154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.698154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.698154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.698446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.698945] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.699041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.699146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.699265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.699364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.699467] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.938969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.939811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.202223] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.202414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.202455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.202692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.202786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.203089] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.203089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.203321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.203321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.203556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.203556] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 already deleted. [ 1005.203556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.305821] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.306443] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.306598] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.306867] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.309870] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.310105] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.310434] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.310680] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.310886] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.311146] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.311325] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.311418] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.311921] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.312081] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.312229] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.312369] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.332578] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.332756] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.332896] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.333096] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.333431] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-27b8f57c-3b5f-47b6-942c-713564bcb589 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.333603] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.333718] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.334068] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.334524] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b8f57c-3b5f-47b6-942c-713564bcb589',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.337811] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1005.338114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.338288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.338525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.338842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.338985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.339096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.339280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.339399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.339514] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.806849] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1005.807245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.807543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.807915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.808391] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.837288] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.837650] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.837797] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.838080] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.838237] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.838435] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 27b8f57c-3b5f-47b6-942c-713564bcb589 not found, creating... [ 1005.838780] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.839075] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.839222] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.839480] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.839636] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.839933] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.840201] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.840385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.840655] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.840839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.841034] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 27b8f57c-3b5f-47b6-942c-713564bcb589 is going to be created. [ 1005.842925] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.867107] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.867359] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.867594] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.867891] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.868162] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.868397] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.315075] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.315075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.315075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.315075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.315716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.315716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.315716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.315716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.315716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.315925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.315964] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.345809] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.347515] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 1006.347758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.586164] env[66123]: INFO networking_nsxv3.common.synchronization [req-64460a27-ff6a-4ab5-9b8b-2d14508c014d req-aa8e3ea4-43bf-4879-8cc0-ba22de0e888f service nova] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 1006.586309] env[66123]: INFO networking_nsxv3.common.synchronization [req-64460a27-ff6a-4ab5-9b8b-2d14508c014d req-aa8e3ea4-43bf-4879-8cc0-ba22de0e888f service nova] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1006.586689] env[66123]: INFO networking_nsxv3.common.synchronization [req-64460a27-ff6a-4ab5-9b8b-2d14508c014d req-aa8e3ea4-43bf-4879-8cc0-ba22de0e888f service nova] Enqueued Resource ID: 27b8f57c-3b5f-47b6-942c-713564bcb589 with Priority: HIGHEST for action port [ 1006.587274] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 1006.587562] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1006.587779] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b8f57c-3b5f-47b6-942c-713564bcb589 with Priority: HIGHEST for action port [ 1006.588191] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.588367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.588497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.588732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.588845] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.589998] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.590165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.590263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.590515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.590805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.590875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.590956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.591183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.591307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.591437] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.592776] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-27b8f57c-3b5f-47b6-942c-713564bcb589 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.593167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.593167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.593224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.593332] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b8f57c-3b5f-47b6-942c-713564bcb589',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.818262] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.818801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.818965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.819304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.819621] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.819886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.820068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.820322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.821020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.821020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.821020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.821020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.821020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.821362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.821362] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.821438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.821468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.821635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.821705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.821750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.821859] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.849780] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.849780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.849780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.849780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.849780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.849780] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 1006.881031] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.881272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.881272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.881487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.881614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.893385] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 1007.095018] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.095262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.095462] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.097922] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27b8f57c-3b5f-47b6-942c-713564bcb589 with status ACTIVE [ 1007.098174] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.098296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.098366] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.098577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.098666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.099138] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.099138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.099138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.099274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.099274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.100056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.100056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.100056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.100056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.100056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.100056] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27b8f57c-3b5f-47b6-942c-713564bcb589 is going to be updated. [ 1007.123974] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.124247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.124358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.124632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.124813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.125032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27b8f57c-3b5f-47b6-942c-713564bcb589" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.285305] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e4c08be-001c-4813-b2d0-13a8c92d7710 req-fa4a9496-bb31-4413-ab4e-0fe3140c2d52 tempest-ServersTestJSON-1133831859 tempest-ServersTestJSON-1133831859-project-member] Enqueued Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_members [ 1007.286052] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_members [ 1007.286499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.286559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.286650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.286902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.287171] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.287316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.287434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.287657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.287708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.288465] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.324933] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fb7a681-0823-49de-9892-747a25a5f324: rpc.has_security_group_logging(os_id): False [ 1007.343759] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.343916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.343998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.344412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.344530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.344827] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.344973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.345061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.345309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.345435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.345614] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.345714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.345777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.345924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.345997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.346194] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.346286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.346348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.346539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.346623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.346711] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1007.427162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.427394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.427394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.427717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.427874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.444216] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1007.598015] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.636173] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.636439] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.636538] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.636925] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.637230] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.637456] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.637593] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.637854] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.638041] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.638279] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.638514] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.638514] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.638620] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.638694] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.638791] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.639150] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.671259] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.671259] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1007.671259] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.671259] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-90" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.671501] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-30166cc3-e926-4c15-8861-ac4bb13c6ec2 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.671686] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.671802] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.672183] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.672323] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30166cc3-e926-4c15-8861-ac4bb13c6ec2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.790983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.791186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.791253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.791475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.791567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.791789] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.791898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.791965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.792102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.792177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.792261] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f already deleted. [ 1007.792342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.102192] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.102482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.102554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.102865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.103029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.103183] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be created. [ 1008.131598] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.131598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.131598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.131598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.131598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.143418] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: UNINITIALIZED for 2s [ 1008.175678] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.177571] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 30166cc3-e926-4c15-8861-ac4bb13c6ec2 not found, creating... [ 1008.177571] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.177571] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.178074] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.178074] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.178172] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.178382] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.178533] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.178675] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 30166cc3-e926-4c15-8861-ac4bb13c6ec2 is going to be created. [ 1008.201325] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.201528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.201659] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.202046] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.202318] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.202656] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.906166] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1008.907257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.907385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.907703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.908121] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.908280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.908386] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.908530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.908608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.908722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.908784] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.928057] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e4c08be-001c-4813-b2d0-13a8c92d7710 req-6d27ab17-9fdf-4a7c-9b5e-2f81260e68d0 service nova] Enqueued Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_rules [ 1008.928330] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e4c08be-001c-4813-b2d0-13a8c92d7710 req-6d27ab17-9fdf-4a7c-9b5e-2f81260e68d0 service nova] Enqueued Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_members [ 1008.928527] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e4c08be-001c-4813-b2d0-13a8c92d7710 req-6d27ab17-9fdf-4a7c-9b5e-2f81260e68d0 service nova] Enqueued Resource ID: 30166cc3-e926-4c15-8861-ac4bb13c6ec2 with Priority: HIGHEST for action port [ 1008.929264] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_rules [ 1008.929473] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_members [ 1008.931086] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30166cc3-e926-4c15-8861-ac4bb13c6ec2 with Priority: HIGHEST for action port [ 1008.931479] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.932021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.932149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.932422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.932527] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.934132] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.934305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.934339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.934543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.934759] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.934826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.934931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.935055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.935159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.935281] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.936550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-30166cc3-e926-4c15-8861-ac4bb13c6ec2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.936898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.936898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.936977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.937034] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30166cc3-e926-4c15-8861-ac4bb13c6ec2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.182641] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1009.182831] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1009.413221] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.413416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.413489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.413738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.413922] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.414034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.414097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.414291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.414501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.414536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.416385] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.416385] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.416385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.416385] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.434539] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.434764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.445107] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.445107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30166cc3-e926-4c15-8861-ac4bb13c6ec2 with status ACTIVE [ 1009.445107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.445107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.445107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.447286] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.447286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.447286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.447286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.447752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.448642] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30166cc3-e926-4c15-8861-ac4bb13c6ec2 is going to be updated. [ 1009.472846] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1009.473082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.476074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.476074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.476299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.476393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.476608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.476915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30166cc3-e926-4c15-8861-ac4bb13c6ec2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.825526] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ee69d27-bb55-4db2-913a-3d4ad57f4fdb req-dc6424f3-8517-4a49-bd44-84d06cf66f28 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1009.826077] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1009.826489] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.826618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.826685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.826878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.827356] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.827356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.827356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.827356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.827608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.827608] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.918254] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6b25007-70eb-4a46-96cf-27a55632b2b5: rpc.has_security_group_logging(os_id): False [ 1009.944480] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.944789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.944908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.946435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.946435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.946435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.946435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.946435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.946639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.946770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.947033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.947199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.947282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.947462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.947542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.948054] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.948054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.948204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.950833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.950833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.950833] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 1009.950833] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.026766] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.027054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.027173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.027472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.027741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.046434] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 1010.159623] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.159623] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.159623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.159623] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.227470] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.227681] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.227806] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.228077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.228334] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.228776] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.228935] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.229792] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.229792] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.229977] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.230136] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.230279] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.230524] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.230699] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.230841] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.231007] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.253804] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.254127] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1010.254419] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.254708] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.255101] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-94a52006-c10d-4569-892e-95a4f3fef129 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.255452] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.255653] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.256035] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.256306] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a52006-c10d-4569-892e-95a4f3fef129',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.330254] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.330428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.330500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.330729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.330821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.331039] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.331144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.331208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.331377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.331461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.331552] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1010.362357] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.362931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.363882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.364042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.364227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.375468] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1010.452769] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.452769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.452769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.453288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.453388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.453558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f is going to be created. [ 1010.482460] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.482460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.482460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.482666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.482705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.492490] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1932f921-51c6-4f18-8e91-2dc524b8516f in Status: UNINITIALIZED for 2s [ 1010.662401] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.759615] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.759843] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.759902] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.760196] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.760363] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.760548] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 94a52006-c10d-4569-892e-95a4f3fef129 not found, creating... [ 1010.760796] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.760954] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.761084] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.761311] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.761450] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.761730] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.761886] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.762009] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.762227] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.762362] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.762509] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 94a52006-c10d-4569-892e-95a4f3fef129 is going to be created. [ 1010.783344] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.783586] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.783716] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.784018] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.784267] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.784501] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.165082] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e7447a7-e95d-4976-8f9e-99f0425169e1: rpc.has_security_group_logging(os_id): False [ 1011.185060] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.185225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.185349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.185665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.185777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.186127] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.186256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.186316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.186545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.186632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.186730] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be created. [ 1011.278387] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.278728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.278786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.279035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.279238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.292892] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: IN_PROGRESS for 2s [ 1011.504628] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ee69d27-bb55-4db2-913a-3d4ad57f4fdb req-dbdcbbad-61ce-4458-97c3-2567f037fa3b service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 1011.504823] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ee69d27-bb55-4db2-913a-3d4ad57f4fdb req-dbdcbbad-61ce-4458-97c3-2567f037fa3b service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1011.504965] env[66123]: INFO networking_nsxv3.common.synchronization [req-1ee69d27-bb55-4db2-913a-3d4ad57f4fdb req-dbdcbbad-61ce-4458-97c3-2567f037fa3b service nova] Enqueued Resource ID: 94a52006-c10d-4569-892e-95a4f3fef129 with Priority: HIGHEST for action port [ 1011.505511] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 1011.505682] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1011.505743] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a52006-c10d-4569-892e-95a4f3fef129 with Priority: HIGHEST for action port [ 1011.506581] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.506736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.506815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.507085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.507129] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.508304] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.508304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.508546] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-94a52006-c10d-4569-892e-95a4f3fef129 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.508712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.508832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.508974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.509101] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a52006-c10d-4569-892e-95a4f3fef129',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.012087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.012087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.013656] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94a52006-c10d-4569-892e-95a4f3fef129 with status ACTIVE [ 1012.014309] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.014516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.014602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.014848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.015216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.015216] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.015378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.015378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.015533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.015617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.015822] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.015917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.015974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.016187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.016266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.016364] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94a52006-c10d-4569-892e-95a4f3fef129 is going to be updated. [ 1012.043522] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.043688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.043767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.043963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.044104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.044268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94a52006-c10d-4569-892e-95a4f3fef129" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.065413] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1012.066156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.066156] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.066250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.066347] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.388024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1012.388024] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 1012.388024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.388024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.388024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.388024] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.388024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.388024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.388024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.388024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.388024] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.510182] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1932f921-51c6-4f18-8e91-2dc524b8516f in Status: SUCCESS [ 1012.510463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.510622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.510881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.511098] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.511251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.511251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.511442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.511512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.511606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.511676] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.569586] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.569863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.569962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.570167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.570357] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.570466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.570535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.570691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.570780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.570875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.570969] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.891244] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.013911] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.073444] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.073627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.073731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.073957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.074161] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.074388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.074388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.074560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.074679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.074799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.074986] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.075122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.075209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.075391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.075556] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.075663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.075735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.075893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.075987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.076113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.076207] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.311793] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1013.311793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.394135] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.517034] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1932f921-51c6-4f18-8e91-2dc524b8516f: rpc.has_security_group_logging(os_id): False [ 1013.536326] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.536514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.536627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.536869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.537075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.537284] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.537403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.537484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.537679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.537755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.537883] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f is going to be created. [ 1013.578792] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6b25007-70eb-4a46-96cf-27a55632b2b5: rpc.has_security_group_logging(os_id): False [ 1013.678085] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.678085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.678085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.678085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.678085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.680583] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.680748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.680789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.680963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.681058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.681289] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.681389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.681451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.681619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.681979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.682058] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.682148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.682209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.682642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.682642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.682642] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.682800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.682800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.682906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.682981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.683306] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 1013.696076] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1932f921-51c6-4f18-8e91-2dc524b8516f in Status: IN_PROGRESS for 2s [ 1013.756121] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.756292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.756374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.756580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.756760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.775219] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 1013.897169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.897169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.897297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.897484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.897649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.897706] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1013.929702] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.930724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.930863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.931508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.931579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.947021] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1015.084648] env[66123]: INFO networking_nsxv3.common.synchronization [req-6b41787c-bc3f-4cdf-9a4c-6c4405752487 req-2d563348-483f-4459-abd2-3be2f87c0bbf tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1015.085212] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1015.085695] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.085695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.085858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.085943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.086121] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.086224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.086300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.086462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.086546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.086637] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.417753] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.417945] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.418070] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.418681] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.418949] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.419123] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.419242] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.419466] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.419615] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.419823] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.419934] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.420051] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.420160] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.420315] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.420379] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.420566] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.448180] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.448344] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.448552] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.448649] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.449034] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-9e415226-794f-4985-97c0-6e4187ffe1be taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.449210] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.450509] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.450509] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.450509] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e415226-794f-4985-97c0-6e4187ffe1be',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.588809] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.589026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.589102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.589423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.589517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.591019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.591019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.591019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.591019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.591019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.591019] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1015.626708] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.626979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.627125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.627462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.627761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.646559] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1015.707428] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1932f921-51c6-4f18-8e91-2dc524b8516f in Status: SUCCESS [ 1015.708067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.791820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1015.791820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.953503] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.953503] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.953689] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.954132] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.954385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.955633] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 9e415226-794f-4985-97c0-6e4187ffe1be not found, creating... [ 1015.955947] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.956150] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.956290] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.956559] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.956756] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.957361] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.957579] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.957752] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.958049] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.958217] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.958389] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 9e415226-794f-4985-97c0-6e4187ffe1be is going to be created. [ 1015.961207] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1015.961493] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.961723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.961909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.963035] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.963035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.963035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.963035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.963035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.963035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.963035] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.983396] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.983666] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.983944] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.984288] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.984642] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.984922] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.464991] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.465294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.465294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.465548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.465718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.465820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.465880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.466058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.466153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.466275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.466471] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.466562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.466642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.466821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.466987] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.467121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.467208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.467425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.467536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.467641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.467769] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.730023] env[66123]: INFO networking_nsxv3.common.synchronization [req-6b41787c-bc3f-4cdf-9a4c-6c4405752487 req-dea3c721-6f46-4660-84de-b976deec92c7 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 1016.730023] env[66123]: INFO networking_nsxv3.common.synchronization [req-6b41787c-bc3f-4cdf-9a4c-6c4405752487 req-dea3c721-6f46-4660-84de-b976deec92c7 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1016.730023] env[66123]: INFO networking_nsxv3.common.synchronization [req-6b41787c-bc3f-4cdf-9a4c-6c4405752487 req-dea3c721-6f46-4660-84de-b976deec92c7 service nova] Enqueued Resource ID: 9e415226-794f-4985-97c0-6e4187ffe1be with Priority: HIGHEST for action port [ 1016.730861] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 1016.731119] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1016.731218] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e415226-794f-4985-97c0-6e4187ffe1be with Priority: HIGHEST for action port [ 1016.731509] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.731627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.732047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.732047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.732047] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.734169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.734266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.734477] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e415226-794f-4985-97c0-6e4187ffe1be taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.734580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.734646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.734858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.736758] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e415226-794f-4985-97c0-6e4187ffe1be',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.973848] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9172499c-e925-4db8-91df-db6b7bc0f5c2: rpc.has_security_group_logging(os_id): False [ 1016.991445] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.991445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.991445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.991445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.991445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.991721] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.991721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.991721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.991835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.992248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.992248] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.992248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.992248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.992502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.992502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.992879] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.992879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.992879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.993996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.994205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.994317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1017.068666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.068666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.068666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.068666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.068666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.083855] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1017.237278] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.237491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.237609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e415226-794f-4985-97c0-6e4187ffe1be with status ACTIVE [ 1017.238266] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.238396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.238467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.238681] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.239148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.239399] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.239474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.239541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.239731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.239814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.240201] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.240332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.240399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.240572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.240656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.240747] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e415226-794f-4985-97c0-6e4187ffe1be is going to be updated. [ 1017.266041] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.266194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.266339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.266518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.266684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.266948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e415226-794f-4985-97c0-6e4187ffe1be" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.578999] env[66123]: INFO networking_nsxv3.common.synchronization [req-0aec9e4a-23b7-48dd-a5e8-8eb7cce4c231 req-51c63b38-9096-4bd1-8909-4233963d8395 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1017.579527] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1017.580291] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.580291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.580291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.580572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.580903] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.580903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.580903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.581071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.581456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.581456] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.659329] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1017.659329] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 1017.659329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.660462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.660462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.660462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.660828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.660940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.661172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.661316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.661486] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.084509] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.132143] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.132353] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.132474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.132744] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.132999] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.137483] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.137643] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.137984] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.138206] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.138426] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.138551] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.138668] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.138806] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.138929] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.139098] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.139938] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.165035] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.166772] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.167027] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.167238] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.167535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-999" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.168232] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.169111] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.171059] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.171059] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.171059] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e5b5a6-4f47-4972-a757-3d339eb9c4c1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.587683] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.672413] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.674296] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.674516] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.674643] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.676734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.676734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.676734] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 not found, creating... [ 1018.676734] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.676734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.676734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.676734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.676734] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.676734] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.677149] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.677149] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.677149] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.677309] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.677422] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 is going to be created. [ 1018.700163] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.700384] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.700506] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.700784] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.701025] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.701259] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.091378] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.091625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.091625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.091853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.091945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.092052] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1019.102317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1019.102539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.118676] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.118865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.118865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.119111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.119273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.128484] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1019.174894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.175651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.175651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.175731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.175946] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.176050] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1019.207514] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.207658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.207804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.207968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.208130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.217927] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1019.504056] env[66123]: INFO networking_nsxv3.common.synchronization [req-0aec9e4a-23b7-48dd-a5e8-8eb7cce4c231 req-9fc943cd-06f7-4476-85f3-3c15b1bd4a74 service nova] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 1019.504056] env[66123]: INFO networking_nsxv3.common.synchronization [req-0aec9e4a-23b7-48dd-a5e8-8eb7cce4c231 req-9fc943cd-06f7-4476-85f3-3c15b1bd4a74 service nova] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1019.504056] env[66123]: INFO networking_nsxv3.common.synchronization [req-0aec9e4a-23b7-48dd-a5e8-8eb7cce4c231 req-9fc943cd-06f7-4476-85f3-3c15b1bd4a74 service nova] Enqueued Resource ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with Priority: HIGHEST for action port [ 1019.504056] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 1019.504056] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1019.504056] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with Priority: HIGHEST for action port [ 1019.505276] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.505276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.505276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.505276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.505276] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.506764] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.506889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.507212] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.507373] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.508211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.508211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.508211] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e5b5a6-4f47-4972-a757-3d339eb9c4c1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.007642] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.008014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.011053] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with status ACTIVE [ 1020.011053] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.011053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.011053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.014294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.014469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.015362] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.015362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.015362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.015362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.015362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.015362] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.015362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.015362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.016261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.016261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.016261] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 is going to be updated. [ 1020.043065] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.043290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.043423] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.043577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.043719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.043906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.263406] env[66123]: INFO networking_nsxv3.common.synchronization [req-d59e11fb-d06e-4e89-8d1c-ed116e9ffd6f req-11ddba26-9c0c-4475-a358-bfe0dff8d6f0 tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1020.264935] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1020.265381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.265546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.265611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.266013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.266198] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.266317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.266386] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.266594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.266688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.266787] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.603179] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.603365] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.603467] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.603720] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.603976] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.604575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.604706] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.605050] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.605212] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.605452] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.605586] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.605700] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.605808] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.605918] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.606037] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.606170] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.624898] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.625120] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.625262] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.625521] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.625934] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-ae07bb46-b22d-4a10-9762-9230455d1c1c taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.626127] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.626263] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.626582] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.626724] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae07bb46-b22d-4a10-9762-9230455d1c1c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.770023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.129093] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.129482] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.129525] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.129797] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.130036] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.130221] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port ae07bb46-b22d-4a10-9762-9230455d1c1c not found, creating... [ 1021.130485] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.130751] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.130751] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.131340] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.131340] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.131625] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.131832] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.131981] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.132263] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.132457] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.132639] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: ae07bb46-b22d-4a10-9762-9230455d1c1c is going to be created. [ 1021.146686] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1021.146983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.147252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.147498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.147709] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.147849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.147966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.148137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.148244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.148363] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.154651] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.155129] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.155129] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.155476] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.155750] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.156016] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.231055] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 4s [ 1021.273869] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.651664] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.776593] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.777309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.777465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.777626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.777742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.777825] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1021.812347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.812347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.812527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.812632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.812919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.824627] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1021.901042] env[66123]: INFO networking_nsxv3.common.synchronization [req-d59e11fb-d06e-4e89-8d1c-ed116e9ffd6f req-2bfb2475-2a20-4ae0-8fca-6cc3f3ad1047 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 1021.901237] env[66123]: INFO networking_nsxv3.common.synchronization [req-d59e11fb-d06e-4e89-8d1c-ed116e9ffd6f req-2bfb2475-2a20-4ae0-8fca-6cc3f3ad1047 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1021.901378] env[66123]: INFO networking_nsxv3.common.synchronization [req-d59e11fb-d06e-4e89-8d1c-ed116e9ffd6f req-2bfb2475-2a20-4ae0-8fca-6cc3f3ad1047 service nova] Enqueued Resource ID: ae07bb46-b22d-4a10-9762-9230455d1c1c with Priority: HIGHEST for action port [ 1021.905882] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 1021.906083] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1021.906190] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae07bb46-b22d-4a10-9762-9230455d1c1c with Priority: HIGHEST for action port [ 1021.906834] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.906834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.906834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.907032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.907091] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.908644] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.908795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.909116] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae07bb46-b22d-4a10-9762-9230455d1c1c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.909261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.909359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.909664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.909801] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae07bb46-b22d-4a10-9762-9230455d1c1c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.153374] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.411605] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.411765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.412013] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae07bb46-b22d-4a10-9762-9230455d1c1c with status ACTIVE [ 1022.412213] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.412340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.412481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.412623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.412720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.412892] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.412989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.413069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.413230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.413335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.413527] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.413627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.413687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.413828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.413902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.413986] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae07bb46-b22d-4a10-9762-9230455d1c1c is going to be updated. [ 1022.438929] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.439102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.439147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.439356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.439604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.439668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae07bb46-b22d-4a10-9762-9230455d1c1c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.509388] env[66123]: INFO networking_nsxv3.common.synchronization [req-7cfd3cf6-0588-4a90-a7de-8b5591d5a4b4 req-9077c7c2-eace-4b7b-9ea2-674213f833f3 tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1022.509388] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1022.509499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.509636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.509728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.509997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.510175] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.510303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.510349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.510826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.511387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.511947] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.656040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.656209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.656209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.656578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.656671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.656785] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1022.708210] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.708769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.708769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.708769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.708978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.721720] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1023.015361] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.015614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.015691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.015908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.040686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.040990] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.041132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.041200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.041455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.041495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.041591] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1023.088178] env[66123]: INFO networking_nsxv3.common.synchronization [req-cae03d92-ff9a-4ad3-b59d-ab6c3f197847 req-e0b394ba-a0f9-48d0-8d50-b3616eaea338 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_members [ 1023.088827] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_members [ 1023.089199] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.089322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.089394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.089711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.089887] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.090011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.090093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.090848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.090848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.090848] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.092876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.093013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.093192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.093274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.093515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.105359] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1023.243696] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1023.244110] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.244110] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.244331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.244680] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.244680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.244805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.244838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.248026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.248026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.248026] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.476841] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.477400] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.477400] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.477508] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.477909] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.477909] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.478150] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.478524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.478524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.478636] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.478721] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.478821] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.478900] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.479022] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.479275] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.479498] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.505471] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.505674] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.505816] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.505994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.506334] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-20bab5c9-d058-44d4-8fef-2cccf62e09f4 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.506617] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.506753] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.507154] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.507318] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bab5c9-d058-44d4-8fef-2cccf62e09f4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.594381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.594381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.594381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.594381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.594381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.594864] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.594864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.594864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.594864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.595000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.595000] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5028f4c-8816-49e2-a746-b352623465f8 already deleted. [ 1023.595087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.747488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.747678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.747727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.748362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.748362] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.748362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.748362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.748596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.748596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.748675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.749234] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.749234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.749234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.749234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.749580] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.749580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.749580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.749713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.749713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.749779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.749943] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.836627] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1023.836924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.837155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.837427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.837666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.837912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.838009] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.838209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.838323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.838445] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.012045] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.012045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.012045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.012045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.012426] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.012426] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 20bab5c9-d058-44d4-8fef-2cccf62e09f4 not found, creating... [ 1024.012606] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.012770] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.012913] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.013160] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.013314] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.013682] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.013841] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.014078] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.014339] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.014476] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.014658] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 20bab5c9-d058-44d4-8fef-2cccf62e09f4 is going to be created. [ 1024.042873] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.043227] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.043426] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.044348] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.044452] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.044779] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.252270] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b3e626-c03f-466a-b911-e8ab22cc99de: rpc.has_security_group_logging(os_id): False [ 1024.276839] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.277088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.277212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.277545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.277696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.278067] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.278210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.278305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.278501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.278584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.278831] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.279014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.279014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.279125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.279179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.279472] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.279575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.279629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.279777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.280115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.280115] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1024.343470] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.368890] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.369060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.369175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.370294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.370294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.389889] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1024.733563] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1024.734300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.734629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.734889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.735252] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.735776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.735776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.736078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.736208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.736443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.736648] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.748648] env[66123]: INFO networking_nsxv3.common.synchronization [req-cae03d92-ff9a-4ad3-b59d-ab6c3f197847 req-1914bb00-56a2-4cb3-8d94-e7c37b81d1f8 service nova] Enqueued Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_rules [ 1024.749901] env[66123]: INFO networking_nsxv3.common.synchronization [req-cae03d92-ff9a-4ad3-b59d-ab6c3f197847 req-1914bb00-56a2-4cb3-8d94-e7c37b81d1f8 service nova] Enqueued Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_members [ 1024.750179] env[66123]: INFO networking_nsxv3.common.synchronization [req-cae03d92-ff9a-4ad3-b59d-ab6c3f197847 req-1914bb00-56a2-4cb3-8d94-e7c37b81d1f8 service nova] Enqueued Resource ID: 20bab5c9-d058-44d4-8fef-2cccf62e09f4 with Priority: HIGHEST for action port [ 1024.751519] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_rules [ 1024.751519] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_members [ 1024.751519] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20bab5c9-d058-44d4-8fef-2cccf62e09f4 with Priority: HIGHEST for action port [ 1024.751812] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.751812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.751910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.752155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.752547] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.753819] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.753967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.754081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.754354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.754731] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.754870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.755056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.755170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.755460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.755460] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.756585] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-20bab5c9-d058-44d4-8fef-2cccf62e09f4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.756790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.756790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.757022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.757145] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bab5c9-d058-44d4-8fef-2cccf62e09f4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.845879] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.117020] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1025.117231] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 deletion is rescheduled due to dependency. [ 1025.117337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.241952] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.242134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.242193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.242579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.242852] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.242996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.243089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.243323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.243462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.243590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.244045] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.244188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.244279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.244515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.246611] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.246611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.246611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.246611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.246611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.246611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.246611] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.260718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.265083] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20bab5c9-d058-44d4-8fef-2cccf62e09f4 with status ACTIVE [ 1025.265083] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.265083] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.265083] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.265083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.266083] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20bab5c9-d058-44d4-8fef-2cccf62e09f4 is going to be updated. [ 1025.266083] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.298306] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.298488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.298532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.298720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.298855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.299041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20bab5c9-d058-44d4-8fef-2cccf62e09f4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.349059] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.349317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.349430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.349765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.349888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.350059] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1025.408103] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.408103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.408103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.408103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.408103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.418303] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1025.425116] env[66123]: INFO networking_nsxv3.common.synchronization [req-9f84b45c-f360-4129-ace1-7db81792a762 req-cc8aff33-06b0-48bc-b193-bee9de7d26d9 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1025.425697] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1025.426082] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.426256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.426306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.426487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.427139] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.427139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.427139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.427139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.427425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.427425] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.747748] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fb7a681-0823-49de-9892-747a25a5f324: rpc.has_security_group_logging(os_id): False [ 1025.768870] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.769070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.769178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.769476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.769621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.769899] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.770051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.770118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.770313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.770430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.770674] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.770780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.770870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.771075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.771270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.771516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.771611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.771666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.771982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.772068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.772195] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1025.773542] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.843130] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.843335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.843391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.843724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.843930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.852822] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.853066] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.853200] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.853512] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.853760] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.853950] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.854085] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.854661] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.854661] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.854768] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.854896] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.855065] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.855178] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.855265] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.855350] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.855510] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.873657] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1025.878456] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.878630] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.878784] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.878984] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.879373] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-fe21ac2d-2547-4690-aba1-8fb2501e432a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.879573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.879699] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.880056] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.880194] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe21ac2d-2547-4690-aba1-8fb2501e432a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.930381] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.275909] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.276363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.276363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.276516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.276516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.276624] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5028f4c-8816-49e2-a746-b352623465f8 is going to be created. [ 1026.308439] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.308593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.308666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.308889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.309067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.325772] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5028f4c-8816-49e2-a746-b352623465f8 in Status: UNINITIALIZED for 2s [ 1026.383080] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.383080] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.383080] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.383080] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.383080] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.383543] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port fe21ac2d-2547-4690-aba1-8fb2501e432a not found, creating... [ 1026.383543] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.383662] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.383716] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.383937] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.384099] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.384386] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.384535] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.384692] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.384843] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.384967] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.385113] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: fe21ac2d-2547-4690-aba1-8fb2501e432a is going to be created. [ 1026.414587] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1026.414842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.422380] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.422641] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.422714] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.422988] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.423245] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.423581] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.432168] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.937681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.937979] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.938072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.938306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.938400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.938597] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1026.980186] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.980186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.980692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.980692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.980692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.990322] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1027.163996] env[66123]: INFO networking_nsxv3.common.synchronization [req-9f84b45c-f360-4129-ace1-7db81792a762 req-73065485-ce3e-42b8-84c6-be0196338427 service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 1027.164273] env[66123]: INFO networking_nsxv3.common.synchronization [req-9f84b45c-f360-4129-ace1-7db81792a762 req-73065485-ce3e-42b8-84c6-be0196338427 service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1027.164451] env[66123]: INFO networking_nsxv3.common.synchronization [req-9f84b45c-f360-4129-ace1-7db81792a762 req-73065485-ce3e-42b8-84c6-be0196338427 service nova] Enqueued Resource ID: fe21ac2d-2547-4690-aba1-8fb2501e432a with Priority: HIGHEST for action port [ 1027.165182] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 1027.165486] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1027.165663] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe21ac2d-2547-4690-aba1-8fb2501e432a with Priority: HIGHEST for action port [ 1027.166053] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.166626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.166626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.166626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.166860] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.170490] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.170626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.170937] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe21ac2d-2547-4690-aba1-8fb2501e432a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.171089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.171683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.171683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.171683] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe21ac2d-2547-4690-aba1-8fb2501e432a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.428470] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1027.428774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.428877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.429127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.429366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.429494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.429562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.429960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.430066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.430160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.430247] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.674411] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.674602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.674778] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe21ac2d-2547-4690-aba1-8fb2501e432a with status ACTIVE [ 1027.674955] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.675093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.675138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.675340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.675447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.675650] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.675757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.675821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.675978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.676077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.676257] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.676382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.676425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.676561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.676639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.676723] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe21ac2d-2547-4690-aba1-8fb2501e432a is going to be updated. [ 1027.703554] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.703718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.703768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.703981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.704139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.704308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe21ac2d-2547-4690-aba1-8fb2501e432a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.892632] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1027.892632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.933049] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.933049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.933049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.933357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.933526] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.933632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.933697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.933875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.933976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.934084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.934213] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.934307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.934369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.934519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.934838] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.934838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.934838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.935042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.935083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.935137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.935232] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.214681] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e388545-1fe9-435a-bc5d-7bacf6301c09 req-c184ecf9-25a1-49c2-8f11-d126c5dc4d5f tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1028.214850] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e388545-1fe9-435a-bc5d-7bacf6301c09 req-c184ecf9-25a1-49c2-8f11-d126c5dc4d5f tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1028.215526] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1028.215636] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1028.215966] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.216904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.217037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.217456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.217636] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.217746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.217826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.218023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.218115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.218213] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.219536] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.219650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.219714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.219871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.220034] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.220136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.220961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.220961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.220961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.220961] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.276942] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e388545-1fe9-435a-bc5d-7bacf6301c09 req-c184ecf9-25a1-49c2-8f11-d126c5dc4d5f tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 1028.277202] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e388545-1fe9-435a-bc5d-7bacf6301c09 req-c184ecf9-25a1-49c2-8f11-d126c5dc4d5f tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1028.277382] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e388545-1fe9-435a-bc5d-7bacf6301c09 req-c184ecf9-25a1-49c2-8f11-d126c5dc4d5f tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_rules [ 1028.277523] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e388545-1fe9-435a-bc5d-7bacf6301c09 req-c184ecf9-25a1-49c2-8f11-d126c5dc4d5f tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1028.277671] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e388545-1fe9-435a-bc5d-7bacf6301c09 req-c184ecf9-25a1-49c2-8f11-d126c5dc4d5f tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with Priority: HIGHEST for action port [ 1028.278779] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 1028.278937] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_rules [ 1028.279058] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with Priority: HIGHEST for action port [ 1028.279175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1028.279290] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1028.281368] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.281368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.281368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.281368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.281368] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.282423] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.282566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.282614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.282867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.283036] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.287663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.287663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.287663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.288257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.288434] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e5b5a6-4f47-4972-a757-3d339eb9c4c1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.290206] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.290206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.290206] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.290479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.339314] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5028f4c-8816-49e2-a746-b352623465f8 in Status: SUCCESS [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.339314] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.339314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.339839] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.438949] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8: rpc.has_security_group_logging(os_id): False [ 1028.462323] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.462860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.463177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.463576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.463861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.464642] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.464642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.464642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.464642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.465019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.465220] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.465369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.465543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.465781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.465907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.466213] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.466357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.466496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.466740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.466894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.467046] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1028.557698] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.557698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.557698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.557698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.557698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.582481] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1028.720917] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.722681] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.793545] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with status ACTIVE [ 1028.793545] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.793545] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.793545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.794145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.794145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.794145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.794145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.794290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.794290] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 is going to be updated. [ 1028.796148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.796324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.796609] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.796743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.822472] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.822472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.822472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.822472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.822472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.822827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.842235] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.002054] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1029.002326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.002721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.003060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.003263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.003466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.003544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.003727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.003840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.003959] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.223980] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.225686] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.344641] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5028f4c-8816-49e2-a746-b352623465f8: rpc.has_security_group_logging(os_id): False [ 1029.365886] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.366090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.366090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.366261] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.366358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.366613] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.366868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.367368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.367368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.367368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.367368] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5028f4c-8816-49e2-a746-b352623465f8 is going to be created. [ 1029.448618] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.448618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.449103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.449103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.449187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.467756] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5028f4c-8816-49e2-a746-b352623465f8 in Status: IN_PROGRESS for 2s [ 1029.507366] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.726617] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.726843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.726885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.727137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.727224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.727333] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd is going to be created. [ 1029.728663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.728772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.728835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.729000] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.729091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.729179] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1029.757930] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.758304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.758475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.758875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.759214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.765205] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.765457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.765565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.765935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.766163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.774050] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: UNINITIALIZED for 2s [ 1029.777629] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1030.010358] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.513974] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.513974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.513974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.514426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.514426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.514426] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1030.550773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.550961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.551089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.551288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.551505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.564196] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1030.612053] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1030.612310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.484973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5028f4c-8816-49e2-a746-b352623465f8 in Status: SUCCESS [ 1031.485364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.786224] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: SUCCESS [ 1031.786707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.786707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.786932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.787187] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.787333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.787411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.787630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.787734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.787883] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.789575] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1031.789890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.789998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.790182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.790398] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.790556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.790648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.790825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.790912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.790996] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.295433] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.295875] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.413994] env[66123]: INFO networking_nsxv3.common.synchronization [req-3dc577d5-e30a-4f12-9f65-639ec8b8f0b3 req-bf44a41f-79ee-420d-8cf1-43d23bc97237 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1032.414983] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1032.414983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.414983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.414983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.415227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.415380] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.415448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.415482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.415819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.415819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.415942] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.421936] env[66123]: INFO networking_nsxv3.common.synchronization [req-56b6bc42-1525-4ac2-abd7-a7d2eb4616a9 req-6ff5e59f-7b79-4ed0-a66d-a1c1a27a444a tempest-ListServersNegativeTestJSON-1592154545 tempest-ListServersNegativeTestJSON-1592154545-project-member] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 1032.421936] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 1032.422840] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.422840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.422840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.422840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.422840] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.423179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.423179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.423179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.423179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.423301] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.574878] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.577434] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.577434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.577434] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.691888] env[66123]: INFO networking_nsxv3.common.synchronization [req-6115b000-8f02-42e7-a18a-032071b06bc8 req-3307b960-632e-468c-9ad5-42c2b4b6945d tempest-ListServersNegativeTestJSON-1592154545 tempest-ListServersNegativeTestJSON-1592154545-project-member] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 1032.692806] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGHEST for action security_group_members [ 1032.693283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.693468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.797739] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.799555] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.917971] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.919095] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.919095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.919593] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1032.925254] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.955127] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.955281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.955344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.955559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.955744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.968058] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1033.080955] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.081161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.081258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.081519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.081723] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.081834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.081914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.082150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.082314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.082497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.082710] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.082838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.082916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.083097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.083285] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.083403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.083551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.083714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.083836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.083937] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.084061] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.302046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.302046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.302046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.302046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.302046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.302046] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd is going to be updated. [ 1033.303428] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.303428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.303590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.303867] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.303953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.304071] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1033.341654] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.341964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.341964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.342417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.342656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.353483] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.353727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.353815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.354076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.354259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.356996] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1033.362906] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: IN_PROGRESS for 2s [ 1033.429136] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.586486] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 1033.610762] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.610969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.610969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.611207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.611304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.611499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.611603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.611668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.611829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.611927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.612160] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.612259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.612323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.612472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.612588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.612801] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.612900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.612976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.613205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.613324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.613406] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1033.682402] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.682751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.682924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.683250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.683502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.703273] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1033.931800] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.932319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.932319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.932582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.932582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.932762] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 1033.966725] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.967445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.967445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.977794] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 1034.058240] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1034.058240] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1034.058426] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_members [ 1034.059361] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1034.059361] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1034.059361] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_members [ 1034.059485] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.059586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.060731] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.060731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.060731] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d088393b-23dd-4054-bc44-6960d628c6aa taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.060731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.060731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.060731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.061174] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.061174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.061174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.061174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.061587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.061587] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.109558] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 1034.109771] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1034.109911] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_rules [ 1034.110055] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_members [ 1034.110183] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_rules [ 1034.110303] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1034.110528] env[66123]: INFO networking_nsxv3.common.synchronization [req-004c1c40-f61d-4494-9781-4a96ce8f45a6 req-8b8a3200-50b2-4b35-a180-51bfaa794fc4 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with Priority: HIGHEST for action port [ 1034.111216] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_rules [ 1034.111360] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_rules [ 1034.111458] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1034.111549] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with Priority: HIGHEST for action port [ 1034.111726] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_rules [ 1034.111931] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1034.112068] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_members [ 1034.112727] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.112727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.113079] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d088393b-23dd-4054-bc44-6960d628c6aa taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.113217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.113293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.113625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.113625] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.114674] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.114774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.114972] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.115092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.115164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.115399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.115578] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e5b5a6-4f47-4972-a757-3d339eb9c4c1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.116448] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.116545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.116891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.116942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.117838] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d088393b-23dd-4054-bc44-6960d628c6aa taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.117838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.566612] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.618963] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 with status ACTIVE [ 1034.619283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.619458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.619534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.619818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.619921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.620179] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.620303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.620443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.620597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.620725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.620992] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.621166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.621248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.621374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.621455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.621545] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48e5b5a6-4f47-4972-a757-3d339eb9c4c1 is going to be updated. [ 1034.625661] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d088393b-23dd-4054-bc44-6960d628c6aa taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.625871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.653388] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.653682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.653758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.654549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.654549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.654549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48e5b5a6-4f47-4972-a757-3d339eb9c4c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.927318] env[66123]: INFO networking_nsxv3.common.synchronization [req-3d2079c7-ede4-4951-89ae-fa869abb8c35 req-90f6f8c8-44a7-44d9-bdd0-e5c62ad950de tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1034.928658] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1034.929112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.929607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.929742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.929950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.930181] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.931064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.931064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.931064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.931064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.931064] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.984804] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1034.985099] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 1034.985184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.071455] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.370808] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1035.371087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.371259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.371498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.371694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.371813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.371883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.372053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.372258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.372368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.372431] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.373424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.373593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.373774] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.373887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.373951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.374297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.374297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.374297] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.376436] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: SUCCESS [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.378900] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.378900] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.378900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.379835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.379835] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.379835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.379835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.379835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.379835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.379835] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.420920] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.421317] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.421510] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.421876] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.422263] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.422497] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.422674] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.422984] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.423212] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.423507] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.423957] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.423957] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.424095] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.424175] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.424473] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.424718] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.434045] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.444596] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.444766] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.444901] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.445103] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.445428] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.445822] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.445822] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.446163] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.446338] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48bf169e-b16c-4ec3-a27d-d96dfdbdba8a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.571770] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.572549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.572671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.572880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.572977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.573101] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d088393b-23dd-4054-bc44-6960d628c6aa is going to be created. [ 1035.602153] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.602348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.602348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.602653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.602722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.616240] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d088393b-23dd-4054-bc44-6960d628c6aa in Status: UNINITIALIZED for 2s [ 1035.723165] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1035.723408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.876074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.876212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.876755] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.883488] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.883590] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.936862] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.949917] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.950327] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.950491] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.950913] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.951121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.951363] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 48bf169e-b16c-4ec3-a27d-d96dfdbdba8a not found, creating... [ 1035.951764] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.951995] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.952892] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.953544] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.954898] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.955370] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.955638] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.955794] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.956142] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.956494] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.956550] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 48bf169e-b16c-4ec3-a27d-d96dfdbdba8a is going to be created. [ 1035.983261] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.983554] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.983823] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.984156] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.984482] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.984732] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.988299] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1035.988583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.989135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.989877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.990191] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.990286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.990351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.990546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.990629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.990726] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.379588] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.388352] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fca5e74f-44f3-482d-9913-0d9eda92a1dd: rpc.has_security_group_logging(os_id): False [ 1036.389614] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.411183] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.411391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.411469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.411798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.413020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.413020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.413020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.413020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.413020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.413020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.413020] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd is going to be created. [ 1036.441553] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.441711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.442624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.442624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.442624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.442624] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be updated. [ 1036.471403] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.471572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.471646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.471876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.472036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.473936] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.474063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.474137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.474319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.474483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.485466] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: IN_PROGRESS for 2s [ 1036.486713] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: IN_PROGRESS for 2s [ 1036.493298] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.493436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.493564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.493791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.493884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.494088] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.494190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.494253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.494411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.494488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.494572] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be updated. [ 1036.521662] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.521662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.521662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.522523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.522523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.534510] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: IN_PROGRESS for 2s [ 1036.883040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.883040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.883214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.883360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.883454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.883556] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1036.893818] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.893999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.894062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.894279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.894416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.894516] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd is going to be updated. [ 1036.916823] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.916823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.916823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.916823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.917231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.921154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.921154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.921154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.921550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.921550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.932412] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: IN_PROGRESS for 2s [ 1036.933156] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1037.138165] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.138165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.138165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.138820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.138820] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.191335] env[66123]: INFO networking_nsxv3.common.synchronization [req-3d2079c7-ede4-4951-89ae-fa869abb8c35 req-015bb033-e821-4931-8875-f2cbe6933e1c service nova] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 1037.191510] env[66123]: INFO networking_nsxv3.common.synchronization [req-3d2079c7-ede4-4951-89ae-fa869abb8c35 req-015bb033-e821-4931-8875-f2cbe6933e1c service nova] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1037.191721] env[66123]: INFO networking_nsxv3.common.synchronization [req-3d2079c7-ede4-4951-89ae-fa869abb8c35 req-015bb033-e821-4931-8875-f2cbe6933e1c service nova] Enqueued Resource ID: 48bf169e-b16c-4ec3-a27d-d96dfdbdba8a with Priority: HIGHEST for action port [ 1037.192255] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_rules [ 1037.192545] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1037.192545] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48bf169e-b16c-4ec3-a27d-d96dfdbdba8a with Priority: HIGHEST for action port [ 1037.192913] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.193583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.193694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.193888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.193970] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.195288] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.195379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.195570] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.195744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.195810] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.196125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.196249] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48bf169e-b16c-4ec3-a27d-d96dfdbdba8a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.568442] env[66123]: INFO networking_nsxv3.common.synchronization [req-6ee1dff2-392e-4b37-b28a-a8c15a934e41 req-d1da900a-6226-4c99-8ba9-e9e87be0cfa5 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1037.568442] env[66123]: INFO networking_nsxv3.common.synchronization [req-6ee1dff2-392e-4b37-b28a-a8c15a934e41 req-d1da900a-6226-4c99-8ba9-e9e87be0cfa5 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1037.568442] env[66123]: INFO networking_nsxv3.common.synchronization [req-6ee1dff2-392e-4b37-b28a-a8c15a934e41 req-d1da900a-6226-4c99-8ba9-e9e87be0cfa5 tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_members [ 1037.569095] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd with Priority: HIGHEST for action security_group_members [ 1037.569234] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1037.570260] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d088393b-23dd-4054-bc44-6960d628c6aa with Priority: HIGHEST for action security_group_members [ 1037.570260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca5e74f-44f3-482d-9913-0d9eda92a1dd taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.570260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.570260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.570260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.570260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d088393b-23dd-4054-bc44-6960d628c6aa taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.570260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.627813] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d088393b-23dd-4054-bc44-6960d628c6aa in Status: SUCCESS [ 1037.627813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.627813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.627813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.628151] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.628151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.628252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.628382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.628426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.628570] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.641552] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.696731] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.696922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.698352] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48bf169e-b16c-4ec3-a27d-d96dfdbdba8a with status ACTIVE [ 1037.698680] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.698897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.699077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.699349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.699473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.699658] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.699756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.699815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.699968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.700133] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.700234] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.700323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.700381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.700518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.700588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.700682] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48bf169e-b16c-4ec3-a27d-d96dfdbdba8a is going to be updated. [ 1037.735481] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.735752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.735752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.735963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.736116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.736280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48bf169e-b16c-4ec3-a27d-d96dfdbdba8a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.131382] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.131544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.131945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.131945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.131945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.132160] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.132266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.132328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.132491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.132568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.132659] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d088393b-23dd-4054-bc44-6960d628c6aa is going to be deleted. [ 1038.146524] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.168352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.168567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.168675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.168943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.169091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.169253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.169761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.169981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.170213] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.170338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.170436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.170894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.170894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.170894] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.499042] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1038.499042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.499042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.499042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.499042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.499042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.499042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.499042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.499042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.499042] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.500219] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: SUCCESS [ 1038.500615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.500884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.501827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.502114] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.543907] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 in Status: SUCCESS [ 1038.544194] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 deletion is rescheduled due to dependency. [ 1038.544325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.562158] env[66123]: INFO networking_nsxv3.common.synchronization [req-8bd9a2f6-c4a4-47a5-9bcf-f1451e3e18bb req-09236a6e-64b6-4944-a2f6-0292ba2d55d0 tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_members [ 1038.562632] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGHEST for action security_group_members [ 1038.562973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.563220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.563286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.563524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.563712] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.563883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.563994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.564263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.564322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.565032] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.649107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1038.649229] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1038.673038] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.673196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.674026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.674026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.674026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.674026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.674558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.674558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.674558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.674558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.674558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d088393b-23dd-4054-bc44-6960d628c6aa already deleted. [ 1038.676774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.676774] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.676774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.676774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.676774] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.676774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.676774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.676774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.676774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.677173] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.946821] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd in Status: SUCCESS [ 1038.947049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.947243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.947696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.947696] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.948153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.948153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.948153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.948376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.948376] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.951511] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1038.951511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.951765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.951809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.952080] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.952175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.952212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.952352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.952424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.952578] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.005421] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.028990] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.029246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.029326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.029498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.029705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.029851] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd is going to be deleted. [ 1039.067169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.067343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.067417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.067642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.067738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.067949] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.068122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.068192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.068355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.068436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.068524] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 is going to be updated. [ 1039.077304] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.077494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.077494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.077705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.077797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.077907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.131152] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.131317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.131371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.131586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.131723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.147992] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 in Status: IN_PROGRESS for 2s [ 1039.180519] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d088393b-23dd-4054-bc44-6960d628c6aa',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.180519] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.180519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.180519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.180519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.180519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.180896] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.180896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.180978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.181138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.181223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.181313] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d088393b-23dd-4054-bc44-6960d628c6aa already deleted. [ 1039.181394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.451268] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.451671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.451854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.452115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.452206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.452402] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.452502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.452616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.452702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.452793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.452906] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd is going to be deleted. [ 1039.455344] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.482484] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.482632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.482632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.482838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.482993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.483050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.483496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.483667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.483828] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.483921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.483986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.484135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.484214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.484305] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca5e74f-44f3-482d-9913-0d9eda92a1dd',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.508242] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.598533] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.598533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.598533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.598969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.612708] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1039.614252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.614941] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1039.654991] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.655314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.655380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.655594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.666047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.666537] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1039.666537] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1039.666537] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1039.682656] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d088393b-23dd-4054-bc44-6960d628c6aa: rpc.has_security_group_logging(os_id): False [ 1039.703951] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.704170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.704217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.704498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.704534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.706770] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.706770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.706770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.706770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.706770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.706770] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d088393b-23dd-4054-bc44-6960d628c6aa is going to be created. [ 1039.721025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.721235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.721661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.721661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.724104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.724453] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1039.727030] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d088393b-23dd-4054-bc44-6960d628c6aa], does not exist path=[/infra/domains/default/groups/d088393b-23dd-4054-bc44-6960d628c6aa]."\n}' [ 1039.727030] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d088393b-23dd-4054-bc44-6960d628c6aa failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d088393b-23dd-4054-bc44-6960d628c6aa [ 1039.727161] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1039.770101] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.771267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.771267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.771267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.772257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.772893] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.772893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.772893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.773278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.773278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.773747] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.773747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.774278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.774278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.774278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.774278] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d088393b-23dd-4054-bc44-6960d628c6aa is going to be created. [ 1039.794448] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d088393b-23dd-4054-bc44-6960d628c6aa], does not exist path=[/infra/domains/default/groups/d088393b-23dd-4054-bc44-6960d628c6aa]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d088393b-23dd-4054-bc44-6960d628c6aa [ 1039.794856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d088393b-23dd-4054-bc44-6960d628c6aa" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.795065] env[66123]: Traceback (most recent call last): [ 1039.795065] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1039.795065] env[66123]: return func(*args, **kwargs) [ 1039.795065] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1039.795065] env[66123]: res.raise_for_status() [ 1039.795065] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1039.795065] env[66123]: raise HTTPError(http_error_msg, response=self) [ 1039.795065] env[66123]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d088393b-23dd-4054-bc44-6960d628c6aa [ 1039.795065] env[66123]: During handling of the above exception, another exception occurred: [ 1039.795065] env[66123]: Traceback (most recent call last): [ 1039.795065] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1039.795065] env[66123]: listener.cb(fileno) [ 1039.795065] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1039.795065] env[66123]: result = function(*args, **kwargs) [ 1039.795065] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1039.795065] env[66123]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1039.795065] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1039.795065] env[66123]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1039.795065] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1039.795065] env[66123]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1039.795065] env[66123]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1039.795065] env[66123]: res.raise_for_status() [ 1039.795065] env[66123]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1039.795065] env[66123]: raise HTTPError(http_error_msg, response=self) [ 1039.795065] env[66123]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d088393b-23dd-4054-bc44-6960d628c6aa [ 1039.795065] env[66123]: Removing descriptor: 59 [ 1039.824497] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.824643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.824868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.824962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.825282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.825568] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1039.908547] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.908768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.908907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.908998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.909312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.909618] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1039.909715] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'290fd936-57e7-4c7e-9104-b187d1d91b09', '3f94438f-58b5-4c82-8302-4f45a58dee50', '63ce70da-7be6-4476-bdbe-08aaf4677d57', '9172499c-e925-4db8-91df-db6b7bc0f5c2', 'a1b3e626-c03f-466a-b911-e8ab22cc99de', 'e2f1f52d-14fb-4485-8ef3-6e0cc6291fce', 'bbec3ba3-84bb-4f89-a861-89e446288553', 'c3fdb4db-b3f4-4212-be18-d27312664ed6', 'd44fe180-6402-48dd-88de-72f82c8bda2f', '16e086d7-22eb-4e20-9dda-bdb801fe920d', '92becbac-4b94-45df-b2f4-6067bd78d31b', '5e7447a7-e95d-4976-8f9e-99f0425169e1', 'a920e51b-9550-463b-b158-782df4ef60d2', '7190ac8a-97bd-4254-83bd-7f62dd7cd4b4', '4fc16eb3-c511-42d0-ac83-eeb07f37616c', '3af04420-6b85-4613-8554-92a0065c78dc', 'd4d8c960-3749-4fb8-86f5-1b9ff22fa8a8', 'e7b81556-6c94-4aa2-8778-1100ecc2b026', 'de28cfe1-47d1-4e0d-9126-97eb3c037662', '48aac306-03a8-4928-8815-44ca0617408c', '69e73b71-1b94-4c07-a51a-893782ee1e09', '2c6dbcb4-05b5-47cd-91b4-bf12d7469a76', 'c98d0046-6918-47a2-9486-ba2fa2ba7743', '46ae9dcf-d3ab-4655-9efc-c1a218c2dc56', '1932f921-51c6-4f18-8e91-2dc524b8516f', 'e5028f4c-8816-49e2-a746-b352623465f8', '76bf622f-13b1-4d60-b853-8d93458e789a', 'bb8f4e60-4319-40b5-a8f3-20680c5bcb74', 'a6b25007-70eb-4a46-96cf-27a55632b2b5', '86c8a328-51f3-46d6-a72c-f22aefa2fcf2', 'ee0f66d6-515b-47ee-bcf1-99417ad55a0a', 'ae4b87ee-cc63-4241-b970-23c1a58e9362', 'fc1efda8-467e-44a4-8d86-5f1d56a91f3c', '30a272b7-f056-46f6-bc0f-8e33fb6c2cd0', 'c33bec6e-2ebe-4c3c-a232-8a79edacefc8', '6be2818f-6bbe-47a1-a41d-086de5f4b5d0', 'd200e885-c7ad-4101-b6e0-e3026ae4d35f', '7fb7a681-0823-49de-9892-747a25a5f324', '7f8a69fc-5713-4493-96dc-78b604a9517d', '6a1c9505-3726-4617-ab67-cc7b3b1e107b', 'cc8e203a-a322-44a7-8e22-6a43e3c9abbd', '861f81b8-db22-4a30-a43a-194caa55e446', '7021f924-400e-4d63-ac79-b87e4a1fc7d7', 'f3b19fe3-562d-4163-b8e0-7d5f0c6475ed', '1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c'} {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1039.909836] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1039.931536] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.931736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.931789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.932179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.932179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.932179] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1039.932328] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1039.932328] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1039.957979] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.988341] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.988572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.988703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.988955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.989064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.989314] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.990184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.990184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.990184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.990184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.990184] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca5e74f-44f3-482d-9913-0d9eda92a1dd already deleted. [ 1039.990184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca5e74f-44f3-482d-9913-0d9eda92a1dd" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.011033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.011033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.011033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.011033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.011033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.011033] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be updated. [ 1040.027100] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.027309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.027390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.028587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.028834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.029052] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1040.029243] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1040.029243] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1040.029344] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1040.029684] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1040.029684] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGH for action security_group_rules [ 1040.029684] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGH for action security_group_rules [ 1040.029684] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGH for action security_group_rules [ 1040.029684] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGH for action security_group_rules [ 1040.029951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGH for action security_group_rules [ 1040.029951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGH for action security_group_rules [ 1040.029951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGH for action security_group_rules [ 1040.029951] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGH for action security_group_rules [ 1040.030149] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGH for action security_group_rules [ 1040.030149] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGH for action security_group_rules [ 1040.030149] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGH for action security_group_rules [ 1040.030608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGH for action security_group_rules [ 1040.030608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGH for action security_group_rules [ 1040.030608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGH for action security_group_rules [ 1040.030608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGH for action security_group_rules [ 1040.030608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGH for action security_group_rules [ 1040.030608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGH for action security_group_rules [ 1040.030878] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGH for action security_group_rules [ 1040.030878] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGH for action security_group_rules [ 1040.030878] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGH for action security_group_rules [ 1040.030878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.048427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.048427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.048427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.048427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.048427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.058317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: IN_PROGRESS for 2s [ 1040.460576] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.460866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.460866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.461068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.461166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.461271] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1040.497260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.497260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.497260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.497260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.497260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.507623] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [req-f68a658d-40a2-4c23-97b6-73298adbcfc5 req-d51df1e8-b2cf-49ef-9a52-031278023613 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGH for action security_group_rules [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 with Priority: HIGH for action security_group_rules [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGH for action security_group_rules [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c with Priority: HIGH for action security_group_rules [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aac306-03a8-4928-8815-44ca0617408c with Priority: HIGH for action security_group_rules [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGH for action security_group_rules [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 with Priority: HIGH for action security_group_rules [ 1040.577737] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGH for action security_group_rules [ 1040.578097] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGH for action security_group_rules [ 1040.578097] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af04420-6b85-4613-8554-92a0065c78dc with Priority: HIGH for action security_group_rules [ 1040.578097] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGH for action security_group_rules [ 1040.578231] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGH for action security_group_rules [ 1040.578231] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGH for action security_group_rules [ 1040.578291] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGH for action security_group_rules [ 1040.578384] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44fe180-6402-48dd-88de-72f82c8bda2f with Priority: HIGH for action security_group_rules [ 1040.578476] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGH for action security_group_rules [ 1040.578564] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 with Priority: HIGH for action security_group_rules [ 1040.578653] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGH for action security_group_rules [ 1040.578741] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 with Priority: HIGH for action security_group_rules [ 1040.578830] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGH for action security_group_rules [ 1040.579145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.579266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.579361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.579514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.580112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.580226] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.580535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.580535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.580535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.580681] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.581462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.581568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.581630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.581774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.581844] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.582738] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63ce70da-7be6-4476-bdbe-08aaf4677d57 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.582838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.583646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.583646] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.583646] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63ce70da-7be6-4476-bdbe-08aaf4677d57',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.584891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.584891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.584891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.584891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.584891] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.584891] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.584891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.585581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.585581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.585581] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fc16eb3-c511-42d0-ac83-eeb07f37616c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.586078] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48aac306-03a8-4928-8815-44ca0617408c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.586159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.586225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.586369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.586448] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48aac306-03a8-4928-8815-44ca0617408c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.587588] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.587588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.587588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.587896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.587896] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.588366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b81556-6c94-4aa2-8778-1100ecc2b026 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.588467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.588534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.588708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.588768] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b81556-6c94-4aa2-8778-1100ecc2b026',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.589524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.589643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.589709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.589855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.589928] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.590752] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.590862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.590912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.591087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.591168] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.591803] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3af04420-6b85-4613-8554-92a0065c78dc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.591884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.591935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.592097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.592170] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3af04420-6b85-4613-8554-92a0065c78dc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.592914] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.592914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.593082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.593125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.593166] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.593901] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.594019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.594206] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.594272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.594323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.594551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.594551] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.596249] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.596249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.596249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.596249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.596249] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.596249] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d44fe180-6402-48dd-88de-72f82c8bda2f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.596249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.598084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.598084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.598084] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d44fe180-6402-48dd-88de-72f82c8bda2f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.598084] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.598084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.598084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.598084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.598084] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.598485] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3fdb4db-b3f4-4212-be18-d27312664ed6 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.598485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.598485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.598654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.598654] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3fdb4db-b3f4-4212-be18-d27312664ed6',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.599255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.599350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.599473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.599575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.599621] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.602283] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f94438f-58b5-4c82-8302-4f45a58dee50 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.602283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.602283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.602540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.602540] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f94438f-58b5-4c82-8302-4f45a58dee50',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.603444] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.603541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.603630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.604624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.604624] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.606473] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.107024] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.107024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.107024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.107244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.107310] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.107394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.108239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.108239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.108239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.108239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.108239] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.110413] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.110704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.110704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.111113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.111598] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.111598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.111598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.111765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.111765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.111831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.111905] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.115948] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.116108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.116174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.116375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.116541] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.116639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.116710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.116846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.116994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.117093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.117189] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.119022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.119022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.124411] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.124411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.124411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.124411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.124411] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.124411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.124785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.125191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.125191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.125191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.125338] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.126349] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.126464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.126518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.127048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.127048] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.127270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.127270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.127372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.127474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.127584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.127641] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.135522] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.139946] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.141071] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.142895] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.143073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.143073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.143391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.143550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.143697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.144372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.144372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.144372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.144372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.144372] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.165030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.165194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.165251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.165479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.181984] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.181984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.183078] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.183247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.202279] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.202279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.202279] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.202279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.204037] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.204037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.329094] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.329337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.333899] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.334072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.334942] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 in Status: SUCCESS [ 1041.335166] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 deletion is rescheduled due to dependency. [ 1041.335304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.336193] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.336295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.337059] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.337151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.337766] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1041.338277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.338397] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3fdb4db-b3f4-4212-be18-d27312664ed6 is going to be deleted. [ 1041.339337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.339551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.342871] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.343044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.343771] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.343870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.377694] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1041.378340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.378486] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48aac306-03a8-4928-8815-44ca0617408c is going to be deleted. [ 1041.379547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.379847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.427203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.427354] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b is going to be deleted. [ 1041.428421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.428660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.437809] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.438036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.480735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.481115] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be deleted. [ 1041.481892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.482283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.521151] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.521350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.552600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.552824] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63ce70da-7be6-4476-bdbe-08aaf4677d57 is going to be deleted. [ 1041.553766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.553993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.600590] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.600771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.608119] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.608332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.610805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.611100] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be deleted. [ 1041.612159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.612431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.613530] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.628468] env[66123]: INFO networking_nsxv3.common.synchronization [req-ca38ec07-767d-4ce3-b548-3995908ca8ce req-808ac876-c819-460a-96fe-46e072de841a tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1041.629357] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1041.629733] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.629892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.629970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.630166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.630322] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.630419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.630501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.630627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.630700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.630791] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.636506] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.636506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.639824] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.640514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.640654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.641237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.641237] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.641406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.641406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.641543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.641631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.641735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.642103] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.642103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.642238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.642374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.642521] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.643209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.643209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.643209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.643209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.643209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.643209] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.653171] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.653171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.653171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.653519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.656231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.656231] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1041.656939] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f1f52d-14fb-4485-8ef3-6e0cc6291fce: rpc.has_security_group_logging(os_id): False [ 1041.658184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.658265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.658319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.658774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.658960] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.659078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.659141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.659312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.659391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.659474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.659615] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.659703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.659777] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.659944] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.660102] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.660194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.660268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.660404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.660480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.660559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.660646] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.664633] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de28cfe1-47d1-4e0d-9126-97eb3c037662: rpc.has_security_group_logging(os_id): False [ 1041.694859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.695009] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d44fe180-6402-48dd-88de-72f82c8bda2f is going to be deleted. [ 1041.695954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.696139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.710712] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.710712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.711563] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.711973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.722681] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.722985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.735630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.735886] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f94438f-58b5-4c82-8302-4f45a58dee50 is going to be deleted. [ 1041.737432] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.737753] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.761053] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.761253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.791302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.791462] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3af04420-6b85-4613-8554-92a0065c78dc is going to be deleted. [ 1041.792382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.792620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.795218] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.795377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.795444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.795615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.795791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.813210] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1041.836742] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.836927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.838376] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.838552] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fc16eb3-c511-42d0-ac83-eeb07f37616c is going to be deleted. [ 1041.839982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.840484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.889188] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.889394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.936943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.936943] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be deleted. [ 1041.939248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.939248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.970453] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.970662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.993029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.993203] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b81556-6c94-4aa2-8778-1100ecc2b026 is going to be deleted. [ 1041.994285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.994512] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.994615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.994813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3fdb4db-b3f4-4212-be18-d27312664ed6" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.995027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.995227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.995307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48aac306-03a8-4928-8815-44ca0617408c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.996363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.996363] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.996851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.996918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.997047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.997193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.997374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.002111] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.002340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.044589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.044963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.045147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.045248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.046203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.046203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.046317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce is going to be updated. [ 1042.047882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.048203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.073712] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1042.074088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.074986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.074986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.074986] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.075334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.075372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.075727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.075891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.076030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.076177] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.083045] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.083355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.111201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.112064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.112739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.112739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.112739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.112886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.113141] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 is going to be updated. [ 1042.115274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.116143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.116143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.116143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.116143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.116442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.116598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.116817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d44fe180-6402-48dd-88de-72f82c8bda2f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.117078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.117328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.117464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.118268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f94438f-58b5-4c82-8302-4f45a58dee50" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.118268] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 290fd936-57e7-4c7e-9104-b187d1d91b09: rpc.has_security_group_logging(os_id): False [ 1042.119355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.120031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.120185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.120352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3af04420-6b85-4613-8554-92a0065c78dc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.121093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.121309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.121412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.121562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fc16eb3-c511-42d0-ac83-eeb07f37616c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.122667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.122667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.122667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.122667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63ce70da-7be6-4476-bdbe-08aaf4677d57" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.122667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.122667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.122947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.122947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.135550] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.145425] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e086d7-22eb-4e20-9dda-bdb801fe920d: rpc.has_security_group_logging(os_id): False [ 1042.167171] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.167426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.167569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.167889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.169973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9172499c-e925-4db8-91df-db6b7bc0f5c2: rpc.has_security_group_logging(os_id): False [ 1042.207642] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.207885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.211307] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.211522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.228516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.228516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.228516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.228846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.231735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.232101] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.232249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.232335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.233032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.233032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.233032] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be updated. [ 1042.233919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.234158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.234333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.235853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.236100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.237031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.237031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b81556-6c94-4aa2-8778-1100ecc2b026" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.237031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.237031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.296291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.296291] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.296291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.296291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.296291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.296291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.297445] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.297643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.297714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.297942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.298051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.298293] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.298395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.298443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.298913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.298913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.298913] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be updated. [ 1042.300326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.300502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.303136] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: IN_PROGRESS for 2s [ 1042.359411] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.359663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.384856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.385237] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.385409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.385514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.385939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.386082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.386373] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.386502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.386593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.386993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.387118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.387382] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.387484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.387553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.387744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.387837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.387956] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1042.389167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.389370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.389520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.410861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: IN_PROGRESS for 2s [ 1042.460787] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.460787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.461063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.461135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.461360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.499973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: IN_PROGRESS for 2s [ 1042.516130] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.516340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.516340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.516575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.516728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.535576] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1042.535963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.536287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.536639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.536997] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.537146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.537264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.537541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.537686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.537847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.538142] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.538406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.538487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.538662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.538838] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.538958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.539151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.539192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.539399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.539399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.539473] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.540442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.540613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.540782] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.540909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.540988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.541157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.541243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.541333] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.566694] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: IN_PROGRESS for 2s [ 1042.576585] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1042.577794] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.578365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.578538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.578817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.579030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.581092] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.606972] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1042.637623] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.670631] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.671179] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.671179] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.671454] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.671677] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.671844] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.672011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.672271] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.672442] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.672674] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.672789] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.673036] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.673150] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.673204] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.673376] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.674115] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.710846] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.711108] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.711275] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.711600] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-952" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.712255] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.712255] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.712445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.713021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.713021] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be2c89e-b1c5-41ff-9355-a2a4fca7a074',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.044146] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.045144] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fb7a681-0823-49de-9892-747a25a5f324: rpc.has_security_group_logging(os_id): False [ 1043.064808] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.064893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.064928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.065148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.084347] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e7447a7-e95d-4976-8f9e-99f0425169e1: rpc.has_security_group_logging(os_id): False [ 1043.090571] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.090984] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.091182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.091276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.091595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.091650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.091935] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.092085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.092171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.092387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.092495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.092747] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.092880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.092967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.093245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.093291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.093395] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1043.108033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.108033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.108247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.108430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.128144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.128496] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.128624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.128695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.128910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.128996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.129106] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be updated. [ 1043.140633] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.140822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.140905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.141113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.141311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.141311] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1043.172712] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.173063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.173063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.173285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.173452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.185106] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1043.199746] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.199746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.199746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.199746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.199746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.215920] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.216214] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.216327] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.216629] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.216787] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.217105] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.217262] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.217375] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.217603] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.217751] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.218226] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.218383] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.218503] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.218729] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.218863] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.219107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 is going to be updated. [ 1043.227749] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1043.229666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.229836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.229942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.230431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.230431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.295284] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.295580] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.295905] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.296183] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.296519] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.297122] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.298865] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: IN_PROGRESS for 2s [ 1043.547305] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.824530] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1043.824823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.825078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.826275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.826275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.826275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.826275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.826275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.826275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.826275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.826618] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.958053] env[66123]: INFO networking_nsxv3.common.synchronization [req-0dd02493-92ca-4adb-93df-4f769927af3f req-9cbab23f-6c67-481c-8d35-9e0a1fab5606 service nova] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 1043.958284] env[66123]: INFO networking_nsxv3.common.synchronization [req-0dd02493-92ca-4adb-93df-4f769927af3f req-9cbab23f-6c67-481c-8d35-9e0a1fab5606 service nova] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 1043.958419] env[66123]: INFO networking_nsxv3.common.synchronization [req-0dd02493-92ca-4adb-93df-4f769927af3f req-9cbab23f-6c67-481c-8d35-9e0a1fab5606 service nova] Enqueued Resource ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 with Priority: HIGHEST for action port [ 1043.958863] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_rules [ 1043.959035] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 1043.959148] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 with Priority: HIGHEST for action port [ 1043.959496] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.959496] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.959648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.959822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.959822] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.960669] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.960788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.960868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.961265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.961430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.961532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.961574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.961726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.962538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.962538] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.964729] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.964849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.964899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.965073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.965152] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be2c89e-b1c5-41ff-9355-a2a4fca7a074',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.049562] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.049800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.050085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.050335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.050472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.050578] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1044.093874] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.094044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.094111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.094354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.094510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.107873] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1044.322211] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: SUCCESS [ 1044.322462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.330291] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.330542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.330608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.330872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.331086] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.331433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.331433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.331433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.331580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.331580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.331795] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.331888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.331888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.332036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.332162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.332248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.332304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.332479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.332542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.332616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.332692] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.428298] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: SUCCESS [ 1044.428614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.467376] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.469351] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.469351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.469528] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 with status ACTIVE [ 1044.470327] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.470327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.470327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.470327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.470327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.470327] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.470800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.470800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.470800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.470800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.470986] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.470986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.471119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.471169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.471218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.471316] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be2c89e-b1c5-41ff-9355-a2a4fca7a074 is going to be updated. [ 1044.496016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.496192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.496266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.496484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.496622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.496797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be2c89e-b1c5-41ff-9355-a2a4fca7a074" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.515913] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 1044.516125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.589235] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 1044.589635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.623104] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1044.623333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.835466] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 1044.853676] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.853901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.853970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.854209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.872628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.872914] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.873158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.873231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.873815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.873815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.873815] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.873815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.873815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.874071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.874071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.874225] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.874369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.874369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.874509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.874576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.874663] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1044.938633] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.939191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.939191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.939362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.939554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.963024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1044.969925] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.195228] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1045.195455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.195627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.195896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.196128] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.196258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.196324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.196515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.196700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.196775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.196990] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.197166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.197309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.197490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.197715] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.197861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.197962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.198182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.198365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.198365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.198435] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.249645] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1045.249951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.250205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.250723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.250723] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.317020] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1045.317020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.317020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.317020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.317020] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.474573] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.474735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.475400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.475400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.475400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.475400] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b is going to be updated. [ 1045.502284] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.502418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.502482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.503193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.503193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.520041] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: IN_PROGRESS for 2s [ 1045.700333] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8: rpc.has_security_group_logging(os_id): False [ 1045.722265] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.722424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.722486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.722705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.743532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.743967] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.744098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.744098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.744321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.744524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.745196] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.745196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.745196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.745196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.745196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.745407] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.745407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.745407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.745534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.745572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.745675] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1045.752604] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.752769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.808107] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.808292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.808346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.808551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.808702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.819630] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.819861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.819975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.820348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.820498] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.820657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.820745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.820989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.821110] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.821229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.821378] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.829957] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1046.119063] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1046.119063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.119291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.119379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.119542] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.119667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.119727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.119887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.119994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.120116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.120174] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.323741] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.623246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.623525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.623525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.623701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.623879] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.623984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.624410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.624588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.624672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.624764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.624916] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.625031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.625094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.625237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.625373] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.625620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.625620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.625711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.625711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.625833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.625928] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.827124] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e7447a7-e95d-4976-8f9e-99f0425169e1: rpc.has_security_group_logging(os_id): False [ 1046.847914] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.848155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.848401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.848572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.848572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.848762] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.848882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.848935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.849102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.849180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.849272] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be updated. [ 1046.935599] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.935896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.935983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.936227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.936451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.951437] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: IN_PROGRESS for 2s [ 1046.988300] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1046.988544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.128623] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fb7a681-0823-49de-9892-747a25a5f324: rpc.has_security_group_logging(os_id): False [ 1047.147407] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.147568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.147643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.147972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.147972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.148190] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.148296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.148360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.148544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.148624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.148804] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.148916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.149022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.149167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.149254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.149442] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.149538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.149660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.149818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.149898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.149985] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1047.219407] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.219545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.219682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.220089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.222057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.240179] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1047.250016] env[66123]: INFO networking_nsxv3.common.synchronization [None req-e7f42972-789d-4c85-b529-6accee4cead0 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1047.250954] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1047.251207] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.251336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.251406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.251654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.251864] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.251864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.251976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.252074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.252159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.252285] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.530634] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: SUCCESS [ 1047.530914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.531103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.531325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.531521] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.531630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.531697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.531886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.531960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.532018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.532112] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.754746] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.754931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.754989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.755225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.780506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.780738] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.780873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.780942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.781172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.781259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.781353] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 1047.826831] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.827106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.827229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.827574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.827818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.858422] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 1047.865195] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1047.866044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.034948] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.537636] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92becbac-4b94-45df-b2f4-6067bd78d31b: rpc.has_security_group_logging(os_id): False [ 1048.556385] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.556576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.556576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.556808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.556942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.557207] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.557307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.557367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.557527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.557603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.557689] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b is going to be created. [ 1048.615969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.616168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.616243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.616452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.616655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.630812] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: IN_PROGRESS for 2s [ 1048.971960] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1048.972297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.295388] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1049.295388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.870284] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 1049.870413] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 deletion is rescheduled due to dependency. [ 1049.870479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.648868] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: SUCCESS [ 1050.649398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.251714] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1052.251714] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1055.014424] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e151659-03ac-4cc7-bf47-d99309dc28e0 req-fb0c1a81-e8d8-48b4-bd65-4dcacce0312c tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1055.014424] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e151659-03ac-4cc7-bf47-d99309dc28e0 req-fb0c1a81-e8d8-48b4-bd65-4dcacce0312c tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 1055.014424] env[66123]: INFO networking_nsxv3.common.synchronization [req-7e151659-03ac-4cc7-bf47-d99309dc28e0 req-fb0c1a81-e8d8-48b4-bd65-4dcacce0312c tempest-SecurityGroupsTestJSON-1554108009 tempest-SecurityGroupsTestJSON-1554108009-project-member] Enqueued Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_members [ 1055.015067] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGHEST for action security_group_members [ 1055.015067] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGHEST for action security_group_members [ 1055.015067] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGHEST for action security_group_members [ 1055.015963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.015963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.015963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.015963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.015963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.015963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.017027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.017027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.017027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.017027] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.017251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.017361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.017433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.017582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.017729] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.017831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.017905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.017997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.018081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.018382] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.019337] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.019698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.019698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.019698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.019853] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.019853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.020069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.020069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.020174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.020222] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.522538] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.522538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.522740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.522878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.522932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.523197] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.523267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.523336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.523504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.523570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.523659] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be updated. [ 1055.525189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.525189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.525189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.525384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.525384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.525457] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.526289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.526289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.526289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.526289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.526289] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be updated. [ 1055.527112] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.527240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.527240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.527390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.527482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.527638] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.527759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.527801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.527921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.527995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.528089] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 is going to be updated. [ 1055.560789] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.560789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.560789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.560789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.561099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.564138] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.564298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.564377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.564645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.564848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.566848] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.567049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.567049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.567273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.567413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.580834] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: IN_PROGRESS for 2s [ 1055.581768] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: IN_PROGRESS for 2s [ 1055.582395] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: IN_PROGRESS for 2s [ 1055.902509] env[66123]: INFO networking_nsxv3.common.synchronization [req-ccea420b-e983-43a1-8aa0-40efb672b6f9 req-ae756302-a34c-4756-a8c8-20a08f5fc43e tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1055.903148] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1055.903882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.903882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.903882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.903882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.904652] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.905072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.905149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.905837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.905837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.905837] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.192145] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.192568] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.192568] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.192729] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.192993] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.193172] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.193285] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.193501] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.193642] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.193932] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.194079] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.194191] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.194296] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.194402] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.194504] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.194863] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.215520] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.215703] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.215837] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.216108] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.216439] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-03564938-bee1-4e90-9d17-4171d42c7007 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.216651] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.216942] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.217334] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.217456] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03564938-bee1-4e90-9d17-4171d42c7007',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.316692] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.317049] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.317246] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.317647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.318068] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.318324] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.318547] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.318801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.318973] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.319196] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.319310] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.319419] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.319526] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.319636] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.319742] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.319873] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.342924] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.343120] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.343259] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.343439] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.343904] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-5835dad8-220a-4f7d-b605-79ce9cbfe310 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.344049] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.344180] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.344529] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.344673] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5835dad8-220a-4f7d-b605-79ce9cbfe310',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.408215] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.408428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.408504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.408837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.408837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.409073] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.409472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.409541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.409715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.409795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.409902] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be deleted. [ 1056.445762] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.445950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.445950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.446266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.446400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.446527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.719995] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.720317] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.720467] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.720757] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.720905] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.721080] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 03564938-bee1-4e90-9d17-4171d42c7007 not found, creating... [ 1056.721407] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.721585] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.721705] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.721926] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.722083] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.722438] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.722625] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.722802] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.722936] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.723081] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.723224] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 03564938-bee1-4e90-9d17-4171d42c7007 is going to be created. [ 1056.745715] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.746011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.746247] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.746509] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.746754] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.746985] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.847769] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.848035] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.848102] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.848422] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.848573] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.848735] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 5835dad8-220a-4f7d-b605-79ce9cbfe310 not found, creating... [ 1056.849016] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.849188] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.849308] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.849532] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.849668] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.849957] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.850135] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.850253] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.850463] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.850598] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.850737] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 5835dad8-220a-4f7d-b605-79ce9cbfe310 is going to be created. [ 1056.877980] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.878349] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.878497] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.878873] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.879258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.879596] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.481354] env[66123]: INFO networking_nsxv3.common.synchronization [req-33781292-14a0-4dd3-8926-83b6ec0ee53a req-208cc571-38ee-4ecc-8819-6b2d92930771 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 1057.481643] env[66123]: INFO networking_nsxv3.common.synchronization [req-33781292-14a0-4dd3-8926-83b6ec0ee53a req-208cc571-38ee-4ecc-8819-6b2d92930771 service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1057.481865] env[66123]: INFO networking_nsxv3.common.synchronization [req-33781292-14a0-4dd3-8926-83b6ec0ee53a req-208cc571-38ee-4ecc-8819-6b2d92930771 service nova] Enqueued Resource ID: 03564938-bee1-4e90-9d17-4171d42c7007 with Priority: HIGHEST for action port [ 1057.482476] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 1057.482646] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1057.482783] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03564938-bee1-4e90-9d17-4171d42c7007 with Priority: HIGHEST for action port [ 1057.483632] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.483632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.483632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.483803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.483875] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.484872] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.485949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.485949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.485949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.485949] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.485949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.485949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.485949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.486370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.486370] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.487125] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-03564938-bee1-4e90-9d17-4171d42c7007 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.487125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.487125] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.487316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.487316] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03564938-bee1-4e90-9d17-4171d42c7007',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.592957] env[66123]: INFO networking_nsxv3.common.synchronization [req-ccea420b-e983-43a1-8aa0-40efb672b6f9 req-c206ff01-608e-4978-8c14-2d0518fa03e6 service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 1057.592957] env[66123]: INFO networking_nsxv3.common.synchronization [req-ccea420b-e983-43a1-8aa0-40efb672b6f9 req-c206ff01-608e-4978-8c14-2d0518fa03e6 service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1057.592957] env[66123]: INFO networking_nsxv3.common.synchronization [req-ccea420b-e983-43a1-8aa0-40efb672b6f9 req-c206ff01-608e-4978-8c14-2d0518fa03e6 service nova] Enqueued Resource ID: 5835dad8-220a-4f7d-b605-79ce9cbfe310 with Priority: HIGHEST for action port [ 1057.593718] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 1057.593718] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1057.593718] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5835dad8-220a-4f7d-b605-79ce9cbfe310 with Priority: HIGHEST for action port [ 1057.594199] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.594199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.594300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.594702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.594702] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.595757] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.595757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.595956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.596043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.596255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.596255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.596407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.596476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.596518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.596607] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.599271] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5835dad8-220a-4f7d-b605-79ce9cbfe310 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.599402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.599446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.601719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.601719] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5835dad8-220a-4f7d-b605-79ce9cbfe310',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.601719] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 in Status: SUCCESS [ 1057.601719] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 deletion is rescheduled due to dependency. [ 1057.601719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.602726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fb7a681-0823-49de-9892-747a25a5f324 in Status: SUCCESS [ 1057.602881] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 deletion is rescheduled due to dependency. [ 1057.602975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.603703] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 in Status: SUCCESS [ 1057.604030] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 deletion is rescheduled due to dependency. [ 1057.604030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.991706] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.991706] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.991706] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03564938-bee1-4e90-9d17-4171d42c7007 with status ACTIVE [ 1057.991706] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.991706] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.991706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.992336] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.992336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.992336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.992336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.992336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.992336] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03564938-bee1-4e90-9d17-4171d42c7007 is going to be updated. [ 1058.012803] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.012998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.012998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.014186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.014186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.014186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.076288] env[66123]: INFO networking_nsxv3.common.synchronization [req-7988e55c-e6bf-41ac-9f5b-38f4d5cb972b req-c5e9e871-5ba5-4b8f-b9b1-f2f652ff864f tempest-ServersTestJSON-1133831859 tempest-ServersTestJSON-1133831859-project-member] Enqueued Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_members [ 1058.076858] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGHEST for action security_group_members [ 1058.077703] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.077847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.077940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.078162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.078333] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.078437] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.078504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.078660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.078763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.078915] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.099923] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.102673] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.102796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.105498] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5835dad8-220a-4f7d-b605-79ce9cbfe310 with status ACTIVE [ 1058.105694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.105825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.105892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.106146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.106245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.106894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.106894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.106894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.106894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.106894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.107230] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.107230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.107230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.107426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.107426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.107500] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5835dad8-220a-4f7d-b605-79ce9cbfe310 is going to be updated. [ 1058.131927] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.132084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.132159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.132398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.132520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.132658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5835dad8-220a-4f7d-b605-79ce9cbfe310" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.494439] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.581095] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.581343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.581757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.581831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.601780] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.604215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.604215] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.604215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.604215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.604412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.604476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.604565] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f is going to be updated. [ 1058.636022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.636022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.636022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.636022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.636022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.646177] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1932f921-51c6-4f18-8e91-2dc524b8516f in Status: IN_PROGRESS for 2s [ 1058.996989] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.996989] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.997187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.997321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.997442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.997547] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 1059.028116] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.028116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.028385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.028508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.028677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.038121] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 1059.107319] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.107524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.107573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.107797] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.107886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.108018] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be created. [ 1059.134102] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.134313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.134390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.134579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.134765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.146295] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: UNINITIALIZED for 2s [ 1060.655937] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1932f921-51c6-4f18-8e91-2dc524b8516f in Status: SUCCESS [ 1060.656269] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f deletion is rescheduled due to dependency. [ 1060.656350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.784632] env[66123]: INFO networking_nsxv3.common.synchronization [req-3853427e-dd1e-417f-bf75-6c041c59e268 req-26202fdb-12d9-4584-ab57-be7639f5abdf tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 1060.785483] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 1060.785866] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.786124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.786124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.786347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.787118] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.787118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.787118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.787118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.787118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.787350] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.007450] env[66123]: INFO networking_nsxv3.common.synchronization [req-91742712-951a-4ac4-9702-1f0ccdacf2de req-854b8433-c80d-4fb2-85b1-f68f4d73d51b tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_members [ 1061.008068] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGHEST for action security_group_members [ 1061.008627] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.008627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.008627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.009123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.009123] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.009123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.009123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.009306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.009306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.009306] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.049064] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 1061.049274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.049403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.049621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.049818] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.049927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.049987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.050160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.050252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.050331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.050407] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.077652] env[66123]: INFO networking_nsxv3.common.synchronization [req-6b671df9-fc28-424f-91ed-1b320da6c4df req-9c8ac62c-2b2f-4ba3-9ad5-92defdcb88ae tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1061.078196] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1061.078787] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.079214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.079214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.079214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.079362] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.079426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.079488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.079643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.079731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.079823] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.157782] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1061.158072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.158301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.158405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.158708] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.158708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.158929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.158929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.159090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.159169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.159337] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.291092] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.513800] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.513800] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.513800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.513800] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce is going to be updated. [ 1061.543541] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.543541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.543541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.543541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.543541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.554026] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: IN_PROGRESS for 2s [ 1061.554026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.554026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.554026] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.554026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.554941] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.555215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.555446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.555707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.555907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.556168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.556401] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.582719] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.661983] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.792938] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.058973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae4b87ee-cc63-4241-b970-23c1a58e9362: rpc.has_security_group_logging(os_id): False [ 1062.079074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.079238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.079321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.079683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.079683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.080259] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.080259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.080259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.080259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.080259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.080526] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.080672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.080672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.080928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.080928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.081030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.081510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.081510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.081510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.081510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.081510] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 1062.085539] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.149052] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.149052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.149795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.149795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.149795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.168874] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbec3ba3-84bb-4f89-a861-89e446288553: rpc.has_security_group_logging(os_id): False [ 1062.175733] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 1062.190951] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.191281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.191391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.191711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.191874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.192770] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.193105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.193276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.193664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.193835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.197398] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be created. [ 1062.298171] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.298412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.298495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.298696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.298844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.299086] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be updated. [ 1062.327417] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.328216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.328216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.330049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.330049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.346189] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.346189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.346189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.346189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.346189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.349183] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1062.357622] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: IN_PROGRESS for 2s [ 1062.484707] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8ab6fcd-626f-41f6-ae70-9771ac7957ed req-c510c007-ac99-4f4d-9104-ab4650a4ebd8 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1062.485294] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1062.485612] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.485736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.485798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.486011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.486191] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.486292] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.486355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.486527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.487033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.487033] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.589025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.589305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.590123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.590360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.590498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.590608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1062.630592] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.630825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.632021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.632021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.632021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.643217] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1062.912189] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.912189] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.912189] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.912189] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.914827] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.916103] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.916570] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.919354] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.919354] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.919354] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.919354] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.919354] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.919354] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.919354] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.919354] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.919354] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.949453] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.949453] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.949453] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.949453] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.949788] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-67ba8301-b26c-46a4-89f4-4992e376a9d1 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.949983] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.950137] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.950655] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.950796] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ba8301-b26c-46a4-89f4-4992e376a9d1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.990311] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.990486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.990555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.990833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.990964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.991217] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.991323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.991385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.991553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.991633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.991721] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be deleted. [ 1063.024917] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.025257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.025257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.025985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.025985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.025985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.174955] env[66123]: INFO networking_nsxv3.common.synchronization [req-c9b97651-8ee9-4187-a5bd-78c30f0b50e2 req-0fe9a7f2-eba0-4ecb-b859-b2f1382e3c8c tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1063.175813] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1063.176332] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.176529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.176647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.176951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.177277] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.177455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.177578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.177851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.177996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.178176] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.453430] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.453691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.453882] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.455032] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.455032] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.455032] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 67ba8301-b26c-46a4-89f4-4992e376a9d1 not found, creating... [ 1063.455032] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.455286] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.455396] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.456056] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.456056] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.456183] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.456387] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.456575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.456857] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.457093] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.457249] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 67ba8301-b26c-46a4-89f4-4992e376a9d1 is going to be created. [ 1063.481299] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.481592] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.481719] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.482028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.482274] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.482504] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.564497] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce in Status: SUCCESS [ 1063.564695] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce deletion is rescheduled due to dependency. [ 1063.564820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.680546] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.680774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.680774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.681027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.681209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.681427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.681534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.681599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.681787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.681866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.681957] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1063.719902] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.720152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.720152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.720345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.720487] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.729797] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1064.189360] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 1064.189720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.203282] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8ab6fcd-626f-41f6-ae70-9771ac7957ed req-06c343bc-5e64-4ecf-a862-26ef8e0711c6 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 1064.203458] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8ab6fcd-626f-41f6-ae70-9771ac7957ed req-06c343bc-5e64-4ecf-a862-26ef8e0711c6 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1064.203589] env[66123]: INFO networking_nsxv3.common.synchronization [req-e8ab6fcd-626f-41f6-ae70-9771ac7957ed req-06c343bc-5e64-4ecf-a862-26ef8e0711c6 service nova] Enqueued Resource ID: 67ba8301-b26c-46a4-89f4-4992e376a9d1 with Priority: HIGHEST for action port [ 1064.203817] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 1064.203959] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1064.204095] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67ba8301-b26c-46a4-89f4-4992e376a9d1 with Priority: HIGHEST for action port [ 1064.204658] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.204809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.204847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.205042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.205125] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.205992] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.206157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.206225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.206388] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.206534] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.206628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.206690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.206828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.206910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.206995] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.207754] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-67ba8301-b26c-46a4-89f4-4992e376a9d1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.208663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.208663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.208663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.208663] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ba8301-b26c-46a4-89f4-4992e376a9d1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.367025] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1064.367025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.373521] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 1064.373718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.657429] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1064.657429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.709915] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.710993] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.711277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.711418] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67ba8301-b26c-46a4-89f4-4992e376a9d1 with status ACTIVE [ 1064.711589] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.711703] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.711762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.713255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.713255] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.713255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.714350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.714350] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67ba8301-b26c-46a4-89f4-4992e376a9d1 is going to be updated. [ 1064.735086] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.735313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.735369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.735593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.735771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.735972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67ba8301-b26c-46a4-89f4-4992e376a9d1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.212335] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.714744] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.714898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.714974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.715220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.715327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.715427] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be created. [ 1065.741973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.742207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.742295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.742505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.742674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.744310] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1065.744728] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 deletion is rescheduled due to dependency. [ 1065.744896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.752632] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: UNINITIALIZED for 2s [ 1067.768617] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1067.769238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.769238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.769421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.769677] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.769807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.769872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.770059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.770159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.770281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.770381] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.199992] env[66123]: INFO networking_nsxv3.common.synchronization [None req-45a2753f-462d-4123-b608-84af81415330 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: a3144ad0-26cd-402f-95dd-11f9ee447e75 with Priority: HIGHEST for action security_group_rules [ 1068.200555] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3144ad0-26cd-402f-95dd-11f9ee447e75 with Priority: HIGHEST for action security_group_rules [ 1068.200874] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3144ad0-26cd-402f-95dd-11f9ee447e75 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.200996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.201074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.201337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.201420] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3144ad0-26cd-402f-95dd-11f9ee447e75',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.273514] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.273736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.273736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.273960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.274172] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.274280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.274339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.274537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.274595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.274873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.274873] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.275037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.275037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.275112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.275251] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.275342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.275401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.275538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.275612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.275694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.275782] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.298939] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d710d70c-acf1-41c0-b9e0-63624b5dd565 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: a3144ad0-26cd-402f-95dd-11f9ee447e75 with Priority: HIGHEST for action security_group_rules [ 1068.299242] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3144ad0-26cd-402f-95dd-11f9ee447e75 with Priority: HIGHEST for action security_group_rules [ 1068.299554] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3144ad0-26cd-402f-95dd-11f9ee447e75 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.299658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.723057] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.723057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.723409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.723409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.723484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.723555] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3144ad0-26cd-402f-95dd-11f9ee447e75 already deleted. [ 1068.723594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.723786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.723889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.723970] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3144ad0-26cd-402f-95dd-11f9ee447e75',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.779330] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b3e626-c03f-466a-b911-e8ab22cc99de: rpc.has_security_group_logging(os_id): False [ 1068.797266] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.797456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.797647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.797785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.797890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.798155] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.798268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.798333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.798516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.798595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.798856] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.798996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.799089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.799241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.799318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.799529] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.799677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.799714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.799843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.799919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.800026] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be created. [ 1068.948511] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.948664] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.948978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.949237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.949629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.968681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1069.247402] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.247597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.247668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.247825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.247900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.248009] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3144ad0-26cd-402f-95dd-11f9ee447e75 already deleted. [ 1069.248098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3144ad0-26cd-402f-95dd-11f9ee447e75" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.989341] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1070.989661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.770753] env[66123]: INFO networking_nsxv3.common.synchronization [req-511e1bbc-067f-4733-bc27-bb622f46b492 req-ea41df79-a8eb-420c-85f2-0f8fc16bec37 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1071.771287] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1071.771581] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.771695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.771760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.771955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.772116] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.772208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.772341] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.772431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.772481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.772577] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.274783] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.275249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.275249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.275609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.275746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.275980] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.276128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.276243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.276590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.276718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.276879] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1072.305328] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.305547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.305626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.305833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.305973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.316553] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1073.304362] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.304691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.304691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.304812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.305298] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.305298] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.305733] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.305733] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.305733] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.305954] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.305954] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.306130] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.306196] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.306329] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.306398] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.306523] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.328543] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.329069] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.329069] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.329372] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-434" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.329847] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-03564938-bee1-4e90-9d17-4171d42c7007 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.330304] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.330304] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.331625] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.331625] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03564938-bee1-4e90-9d17-4171d42c7007',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.470776] env[66123]: INFO networking_nsxv3.common.synchronization [None req-5dd340e0-3ba7-4a37-852a-2cff2471a139 None None] Enqueued Resource ID: fea85c0b-be6e-4eb8-89f3-52360cd8b5ab with Priority: HIGHEST for action port [ 1073.471652] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea85c0b-be6e-4eb8-89f3-52360cd8b5ab with Priority: HIGHEST for action port [ 1073.472679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-fea85c0b-be6e-4eb8-89f3-52360cd8b5ab taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.472920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fea85c0b-be6e-4eb8-89f3-52360cd8b5ab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.473102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fea85c0b-be6e-4eb8-89f3-52360cd8b5ab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.473592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fea85c0b-be6e-4eb8-89f3-52360cd8b5ab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.473812] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fea85c0b-be6e-4eb8-89f3-52360cd8b5ab',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.838564] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.838564] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.838564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.839194] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.839194] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.839194] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.839194] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.839420] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.839470] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 03564938-bee1-4e90-9d17-4171d42c7007 is going to be updated. [ 1073.868665] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.868904] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.869075] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.869373] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.869557] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.869772] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.978072] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fea85c0b-be6e-4eb8-89f3-52360cd8b5ab [ 1073.978326] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.978498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.978581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.978769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.978858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.978953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fea85c0b-be6e-4eb8-89f3-52360cd8b5ab already deleted. [ 1073.979044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fea85c0b-be6e-4eb8-89f3-52360cd8b5ab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.046110] env[66123]: INFO networking_nsxv3.common.synchronization [req-ff34dac1-f37f-40ee-80a4-cd498d36b0e9 req-02f824ac-a1fe-4f0c-89c0-6a0d9f7aeb9e tempest-ServerRescueNegativeTestJSON-1730165188 tempest-ServerRescueNegativeTestJSON-1730165188-project-member] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 1074.046641] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGHEST for action security_group_members [ 1074.046641] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.046802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.046802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.046951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.047194] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.047306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.047378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.047557] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.047706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.047811] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.327075] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1074.328317] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 1074.328317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.549920] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.550096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.550173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.550387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.550484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.550670] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.550762] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.550818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.550968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.551055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.551136] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be updated. [ 1074.585234] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.585234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.585234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.585234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.585234] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.594562] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: IN_PROGRESS for 2s [ 1074.611238] env[66123]: INFO networking_nsxv3.common.synchronization [req-a69806ad-e781-4943-88db-03b4e0aac17b req-79e80d13-bf66-4506-938d-d11263fac3fa service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 1074.611419] env[66123]: INFO networking_nsxv3.common.synchronization [req-a69806ad-e781-4943-88db-03b4e0aac17b req-79e80d13-bf66-4506-938d-d11263fac3fa service nova] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1074.611557] env[66123]: INFO networking_nsxv3.common.synchronization [req-a69806ad-e781-4943-88db-03b4e0aac17b req-79e80d13-bf66-4506-938d-d11263fac3fa service nova] Enqueued Resource ID: 03564938-bee1-4e90-9d17-4171d42c7007 with Priority: HIGHEST for action port [ 1074.612099] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_rules [ 1074.612233] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1074.612333] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03564938-bee1-4e90-9d17-4171d42c7007 with Priority: HIGHEST for action port [ 1074.612666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.612802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.612871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.613548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.613643] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.619393] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.619393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.619393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.619393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.619393] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.619393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.619393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.619393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.619393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.619393] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.621564] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-03564938-bee1-4e90-9d17-4171d42c7007 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.621564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.621564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.621803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.621803] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03564938-bee1-4e90-9d17-4171d42c7007',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.128247] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.128247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.128247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.128247] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03564938-bee1-4e90-9d17-4171d42c7007 with status ACTIVE [ 1075.128247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.128247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.128247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.128247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.128735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.128735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.128735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.128735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.128966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.128966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.129590] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.129590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.129590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.129590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.130028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.130028] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03564938-bee1-4e90-9d17-4171d42c7007 is going to be updated. [ 1075.153242] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.153473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.153473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.153552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.154121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.154121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03564938-bee1-4e90-9d17-4171d42c7007" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.229249] env[66123]: INFO networking_nsxv3.common.synchronization [req-0d27eb32-efdb-4eba-87ba-b55eff4cab7a req-f0ce0f6c-901e-4a12-b9c5-1da242681231 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_members [ 1075.229925] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGHEST for action security_group_members [ 1075.230473] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.230473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.230473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.230684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.230792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.230891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.230953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.231155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.231247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.231357] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.633455] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.733648] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.733870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.733947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.734190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.756252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.756518] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.756642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.756741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.756910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.756993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.757102] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5028f4c-8816-49e2-a746-b352623465f8 is going to be updated. [ 1075.787815] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.787973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.788039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.788257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.788401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.798148] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5028f4c-8816-49e2-a746-b352623465f8 in Status: IN_PROGRESS for 2s [ 1076.136717] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.136864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.136913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.137120] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.137296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.137414] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 1076.169731] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.169904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.169961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.170237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.170401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.180126] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 1076.310872] env[66123]: INFO networking_nsxv3.common.synchronization [None req-00290dcf-6851-4807-953f-f4d114a7f6d0 None None] Enqueued Resource ID: 35a1af0a-d442-4078-8484-f7d9c1b05d5b with Priority: HIGHEST for action port [ 1076.311624] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35a1af0a-d442-4078-8484-f7d9c1b05d5b with Priority: HIGHEST for action port [ 1076.312015] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-35a1af0a-d442-4078-8484-f7d9c1b05d5b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.312229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35a1af0a-d442-4078-8484-f7d9c1b05d5b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.312325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35a1af0a-d442-4078-8484-f7d9c1b05d5b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.312632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35a1af0a-d442-4078-8484-f7d9c1b05d5b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.312746] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a1af0a-d442-4078-8484-f7d9c1b05d5b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.609154] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d in Status: SUCCESS [ 1076.609379] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d deletion is rescheduled due to dependency. [ 1076.609516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.815246] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35a1af0a-d442-4078-8484-f7d9c1b05d5b [ 1076.815592] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.815763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.815835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.816167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.816238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.816402] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35a1af0a-d442-4078-8484-f7d9c1b05d5b already deleted. [ 1076.816500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35a1af0a-d442-4078-8484-f7d9c1b05d5b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.810896] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5028f4c-8816-49e2-a746-b352623465f8 in Status: SUCCESS [ 1077.811202] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5028f4c-8816-49e2-a746-b352623465f8 deletion is rescheduled due to dependency. [ 1077.811340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.189387] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 1078.189807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.189968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.190289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.190524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.190705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.190894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.191141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.191275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.191425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.191582] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.598450] env[66123]: INFO networking_nsxv3.common.synchronization [req-51ac953e-79ef-433f-9d8b-b53b5086a7a8 req-854ea621-61bc-4c2c-9586-a554ce2f52e4 tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1078.599157] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1078.599347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.599477] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.599544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.599830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.599960] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.600071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.600134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.600278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.600362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.600454] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.693991] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.697087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.697087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.697087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.697087] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.698460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.698460] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.934042] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.934236] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.934307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.934578] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.934839] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.934994] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.935130] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.935352] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.935494] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.935705] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.936061] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.936061] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.936061] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.936747] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.936747] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.936747] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.958926] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.959177] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1078.959281] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.959421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-523" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.959803] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-317d9094-4c0a-437d-ad41-012e618a3077 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.959993] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.960114] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.960493] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.960702] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('317d9094-4c0a-437d-ad41-012e618a3077',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.103050] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.103050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.103050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.103050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.103050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.103050] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.103050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.103050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.103446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.103446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.103446] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1079.128268] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.128414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.128502] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.128692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.128848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.137327] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1079.201517] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae4b87ee-cc63-4241-b970-23c1a58e9362: rpc.has_security_group_logging(os_id): False [ 1079.221800] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.222030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.222030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.222275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.222380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.222591] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.222691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.222756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.222926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.223015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.223229] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.223329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.223393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.223538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.223615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.223796] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.223891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.223954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.224122] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.224247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.224351] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 1079.305588] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.305817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.305817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.306041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.306193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.322664] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 1079.463564] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.463872] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.464073] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.464422] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.464629] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.465228] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 317d9094-4c0a-437d-ad41-012e618a3077 not found, creating... [ 1079.465228] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.465445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.465976] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.465976] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.466159] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.466547] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.466722] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.466952] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.467053] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.467184] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.467350] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 317d9094-4c0a-437d-ad41-012e618a3077 is going to be created. [ 1079.494762] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.494983] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.495122] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.495421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.495660] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.495886] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.231383] env[66123]: INFO networking_nsxv3.common.synchronization [req-51ac953e-79ef-433f-9d8b-b53b5086a7a8 req-64c547bf-935e-48d4-9413-aba8dec255d2 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 1080.231383] env[66123]: INFO networking_nsxv3.common.synchronization [req-51ac953e-79ef-433f-9d8b-b53b5086a7a8 req-64c547bf-935e-48d4-9413-aba8dec255d2 service nova] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1080.231786] env[66123]: INFO networking_nsxv3.common.synchronization [req-51ac953e-79ef-433f-9d8b-b53b5086a7a8 req-64c547bf-935e-48d4-9413-aba8dec255d2 service nova] Enqueued Resource ID: 317d9094-4c0a-437d-ad41-012e618a3077 with Priority: HIGHEST for action port [ 1080.231940] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_rules [ 1080.232092] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1080.232193] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 317d9094-4c0a-437d-ad41-012e618a3077 with Priority: HIGHEST for action port [ 1080.232472] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.232597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.232666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.232876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.232965] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.234185] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.234302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.234504] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-317d9094-4c0a-437d-ad41-012e618a3077 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.235144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.235144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.235144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.235144] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('317d9094-4c0a-437d-ad41-012e618a3077',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.736669] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.736669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.736783] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 317d9094-4c0a-437d-ad41-012e618a3077 with status ACTIVE [ 1080.736928] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.737072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.737109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.737319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.737407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.737575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.737670] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.737726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.737872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.737949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.738172] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.738270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.738329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.738490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.738682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.738769] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 317d9094-4c0a-437d-ad41-012e618a3077 is going to be updated. [ 1080.763788] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.763964] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.764018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.764233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.764372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.764612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-317d9094-4c0a-437d-ad41-012e618a3077" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.838495] env[66123]: INFO networking_nsxv3.common.synchronization [req-2fd7aec7-226e-4250-a653-ba29dd462261 req-f8c5e045-ed0d-4b07-8825-5be718b35bb9 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1080.838495] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1080.838719] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.839080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.839154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.839355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.839543] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.839655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.839719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.839905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.839968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.840075] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.147604] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1081.147821] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 deletion is rescheduled due to dependency. [ 1081.147903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.148107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.148339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.148527] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.148663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.148735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.148888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.148970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.149077] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.339577] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 1081.339837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.343420] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.343577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.343661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.343860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.343958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.344180] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.344334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.344408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.344576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.344652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.344738] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1081.373801] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.373801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.373801] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.374047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.374186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.384078] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1081.651427] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.153723] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.656609] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.656993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.656993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.657104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.657144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.657248] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1082.689183] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.689378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.689378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.689543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.689687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.698091] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1083.394771] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1083.394771] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 1083.394771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.707976] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1084.708355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.708399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.708612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.708877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.708997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.709076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.709238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.709320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.709405] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.709498] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.213162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.213162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.213162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.213162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.213162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.213162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.213162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.213564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.213564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.213564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.213564] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.213564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.213808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.213808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.213886] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.213984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.214106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.214187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.214486] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.214581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.214685] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.717435] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8: rpc.has_security_group_logging(os_id): False [ 1085.739672] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.739880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.739980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.740205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.740333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.740532] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.740635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.740693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.740850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.740928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.741138] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.741236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.741295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.741439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.741523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.741701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.741802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.741857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.741990] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.742093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.742181] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1085.822140] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.822367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.822367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.822579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.822723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.839684] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1085.839889] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1085.839988] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1087.244487] env[66123]: INFO networking_nsxv3.common.synchronization [req-03ae912d-6c65-446a-9308-b9134e201a96 req-e1e62996-f4d4-4a5d-9c7e-f739712280fe tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1087.244875] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1087.245490] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.245490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.245490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.245707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.245751] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.245997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.245997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.246327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.246327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.246327] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.607267] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.607471] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.607616] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.607903] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.608185] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.608341] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.608460] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.608698] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.608853] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.609149] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.609285] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.609394] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.609500] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.609610] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.609740] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.610265] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.634121] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.634121] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.634121] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.634121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.634121] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-cb86d704-cbd0-4adb-a794-8ef831739700 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.634121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.634121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.634121] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.634503] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb86d704-cbd0-4adb-a794-8ef831739700',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.748168] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.748434] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.748489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.748785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.748930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.749215] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.749370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.749458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.749663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.749770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.749888] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1087.780910] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.780910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.780910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.780910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.780910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.793241] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1087.852973] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1087.852973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.136288] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.136545] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.136674] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.136940] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.137096] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.137245] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port cb86d704-cbd0-4adb-a794-8ef831739700 not found, creating... [ 1088.137522] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.137682] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.137795] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.138031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.138171] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.138446] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.138598] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.138715] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.138957] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.139107] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.139245] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: cb86d704-cbd0-4adb-a794-8ef831739700 is going to be created. [ 1088.159075] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.159371] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.159512] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.159793] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.160028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.160264] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.907387] env[66123]: INFO networking_nsxv3.common.synchronization [req-03ae912d-6c65-446a-9308-b9134e201a96 req-82045bae-b8cd-4e34-8eaf-8fc70761f4cb service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 1088.907387] env[66123]: INFO networking_nsxv3.common.synchronization [req-03ae912d-6c65-446a-9308-b9134e201a96 req-82045bae-b8cd-4e34-8eaf-8fc70761f4cb service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1088.907387] env[66123]: INFO networking_nsxv3.common.synchronization [req-03ae912d-6c65-446a-9308-b9134e201a96 req-82045bae-b8cd-4e34-8eaf-8fc70761f4cb service nova] Enqueued Resource ID: cb86d704-cbd0-4adb-a794-8ef831739700 with Priority: HIGHEST for action port [ 1088.907722] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 1088.907722] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1088.907804] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb86d704-cbd0-4adb-a794-8ef831739700 with Priority: HIGHEST for action port [ 1088.909049] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.909049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.909049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.909049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.909049] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.909454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.909590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.909775] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb86d704-cbd0-4adb-a794-8ef831739700 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.909930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.909930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.910119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.910195] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb86d704-cbd0-4adb-a794-8ef831739700',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.412971] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.412971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.413118] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb86d704-cbd0-4adb-a794-8ef831739700 with status ACTIVE [ 1089.413303] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.413456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.413544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.413833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.413888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.414074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.414172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.414233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.414391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.414484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.414672] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.415034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.415034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.415034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.415034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.415272] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb86d704-cbd0-4adb-a794-8ef831739700 is going to be updated. [ 1089.446459] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.446644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.446644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.447132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.447301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.447602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb86d704-cbd0-4adb-a794-8ef831739700" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.674574] env[66123]: INFO networking_nsxv3.common.synchronization [req-a756b5e9-ed4b-4175-9c81-54b58ed5fef0 req-4b41befb-5d74-4eaf-8248-8f349a133cd3 tempest-InstanceActionsNegativeTestJSON-1257969194 tempest-InstanceActionsNegativeTestJSON-1257969194-project-member] Enqueued Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_members [ 1089.675189] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_members [ 1089.675622] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.676218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.676218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.676218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.676218] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.676549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.676549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.676812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.676959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.677291] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.804472] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1089.805022] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 1089.805288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.807980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.807980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.807980] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.807980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.807980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.807980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.808306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.808383] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.018695] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-178 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.019148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-178" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.019148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-178" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.019714] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-178" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.019714] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.019871] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.019871] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.020149] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.020349] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.020651] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.020843] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.020966] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.021157] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.021258] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.021423] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.021748] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.048125] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.048290] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1090.048401] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.048576] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-178" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.048910] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-a79ae06c-dbe9-4149-94de-dad48d3054c7 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.049101] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.049241] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.049715] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.049715] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79ae06c-dbe9-4149-94de-dad48d3054c7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.179038] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.179213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.179284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.179515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.179605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.179798] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.179892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.179953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.180108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.180183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.180267] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 already deleted. [ 1090.180348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.310417] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.551886] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.552136] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.553220] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.553220] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.553220] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.553220] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port a79ae06c-dbe9-4149-94de-dad48d3054c7 not found, creating... [ 1090.553220] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.553658] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.553658] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.553765] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.553877] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.554168] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.554321] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.554479] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.554685] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.554810] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.555045] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: a79ae06c-dbe9-4149-94de-dad48d3054c7 is going to be created. [ 1090.575610] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.575919] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.576061] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.576334] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.576664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.577096] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.815887] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.317641] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.317998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.317998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.318225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.318368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.318480] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1091.326858] env[66123]: INFO networking_nsxv3.common.synchronization [req-a756b5e9-ed4b-4175-9c81-54b58ed5fef0 req-c1ed888f-8d4c-4f38-b3be-a675652208da service nova] Enqueued Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_rules [ 1091.327044] env[66123]: INFO networking_nsxv3.common.synchronization [req-a756b5e9-ed4b-4175-9c81-54b58ed5fef0 req-c1ed888f-8d4c-4f38-b3be-a675652208da service nova] Enqueued Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_members [ 1091.327190] env[66123]: INFO networking_nsxv3.common.synchronization [req-a756b5e9-ed4b-4175-9c81-54b58ed5fef0 req-c1ed888f-8d4c-4f38-b3be-a675652208da service nova] Enqueued Resource ID: a79ae06c-dbe9-4149-94de-dad48d3054c7 with Priority: HIGHEST for action port [ 1091.327752] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_rules [ 1091.327853] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_members [ 1091.327953] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ae06c-dbe9-4149-94de-dad48d3054c7 with Priority: HIGHEST for action port [ 1091.328233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.328351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.328419] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.328668] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.328778] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.329620] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.329713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.329751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.329920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.330079] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.330179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.330243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.330391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.330483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.330578] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.331350] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a79ae06c-dbe9-4149-94de-dad48d3054c7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.331469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.331469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.331627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.331700] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79ae06c-dbe9-4149-94de-dad48d3054c7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.371596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.371596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.371596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.371596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.371939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.385201] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1091.834886] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.835102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.835283] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.836291] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a79ae06c-dbe9-4149-94de-dad48d3054c7 with status ACTIVE [ 1091.836364] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.836433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.836569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.836789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.836987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.837056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.837199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.837259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.837375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.837465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.837685] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.837907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.837907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.837982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.839647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.839647] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a79ae06c-dbe9-4149-94de-dad48d3054c7 is going to be updated. [ 1091.863560] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.863706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.863776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.863991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.864144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.864310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a79ae06c-dbe9-4149-94de-dad48d3054c7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.030919] env[66123]: INFO networking_nsxv3.common.synchronization [req-055544b6-7edd-479e-b30d-3d027f45fefa req-ab14f535-eecd-4fc4-8f9e-f035b48ce705 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1092.031568] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1092.031932] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.032068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.032147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.032375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.032539] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.032639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.032697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.032848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.032984] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.033042] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.344031] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.401830] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.401830] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.402022] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.402269] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.402531] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.402748] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.402883] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.403113] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.403254] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.403461] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.403575] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.403679] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.403785] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.403889] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.404060] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.404279] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.425402] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.425402] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.425577] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.425722] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.426051] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-e248b8ef-b1df-460d-9b2e-f53b271c0e92 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.426291] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.426382] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.426712] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.426854] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e248b8ef-b1df-460d-9b2e-f53b271c0e92',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.444822] env[66123]: INFO networking_nsxv3.common.synchronization [req-c8f13876-d279-4379-a14a-9abb7dc60af2 req-b823b8e4-3d56-44a9-9689-e3cf7590feaf tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1092.446260] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1092.446628] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.446750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.446809] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.447086] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.447314] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.447522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.447522] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.447695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.447805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.447893] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.535425] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.845980] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.846162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.846235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.846484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.846577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.846681] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 is going to be created. [ 1092.875313] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.875599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.875599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.875734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.875898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.890931] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 in Status: UNINITIALIZED for 2s [ 1092.929670] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.933024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port e248b8ef-b1df-460d-9b2e-f53b271c0e92 not found, creating... [ 1092.933024] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.933024] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.933675] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.933675] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.933675] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.933675] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.933675] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.933675] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: e248b8ef-b1df-460d-9b2e-f53b271c0e92 is going to be created. [ 1092.950885] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.962421] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.962421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.962421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.962421] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.962731] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.965537] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.038489] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.398015] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1093.398015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.398015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.398455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.398455] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.398455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.398643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.398678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.398728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.398844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.398952] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.453063] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.540821] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.541075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.541128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.542381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.542381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.542381] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1093.570506] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.570712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.570712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.570938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.571255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.580364] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1093.719634] env[66123]: INFO networking_nsxv3.common.synchronization [req-055544b6-7edd-479e-b30d-3d027f45fefa req-e6f9fdd9-180e-4430-a8d2-c97fc70e743a service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 1093.719838] env[66123]: INFO networking_nsxv3.common.synchronization [req-055544b6-7edd-479e-b30d-3d027f45fefa req-e6f9fdd9-180e-4430-a8d2-c97fc70e743a service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1093.719976] env[66123]: INFO networking_nsxv3.common.synchronization [req-055544b6-7edd-479e-b30d-3d027f45fefa req-e6f9fdd9-180e-4430-a8d2-c97fc70e743a service nova] Enqueued Resource ID: e248b8ef-b1df-460d-9b2e-f53b271c0e92 with Priority: HIGHEST for action port [ 1093.720570] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 1093.720764] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1093.720918] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e248b8ef-b1df-460d-9b2e-f53b271c0e92 with Priority: HIGHEST for action port [ 1093.722374] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.722505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.722619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.722942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.722942] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.723808] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.724107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.724347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-e248b8ef-b1df-460d-9b2e-f53b271c0e92 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.724472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.724583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.724765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.724866] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e248b8ef-b1df-460d-9b2e-f53b271c0e92',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.901425] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.901636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.901688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.902693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.902693] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.902693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.902693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.902693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.902997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.902997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.903113] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.903211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.903273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.903416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.903635] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.903758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.903843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.904046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.904158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.904264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.904390] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.955564] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.955726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.955785] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.956013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.956115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.956214] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be updated. [ 1093.986092] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.986092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.986092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.986092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.986092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.996734] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: IN_PROGRESS for 2s [ 1094.226859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.226859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.227090] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e248b8ef-b1df-460d-9b2e-f53b271c0e92 with status ACTIVE [ 1094.227131] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.227225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.227293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.227553] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.227685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.227852] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.227952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.228035] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.228223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.228306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.228500] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.228597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.228669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.229174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.229174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.229174] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e248b8ef-b1df-460d-9b2e-f53b271c0e92 is going to be updated. [ 1094.272430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.272597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.272669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.272879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.273028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.273219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e248b8ef-b1df-460d-9b2e-f53b271c0e92" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.369883] env[66123]: INFO networking_nsxv3.common.synchronization [req-3f4a8394-28c3-4299-9d7e-4db12d5a4264 req-17f50f3d-fef6-4ee9-a684-b514b071a10d tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 1094.370454] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 1094.370806] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.371148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.371148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.371293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.371377] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.371468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.371531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.371684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.371767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.371860] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.406667] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9172499c-e925-4db8-91df-db6b7bc0f5c2: rpc.has_security_group_logging(os_id): False [ 1094.428616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.428720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.428771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.429060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.429159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.429395] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.429501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.429567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.429778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.429818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.429974] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.430084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.430142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.430295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.430373] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.430567] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.430708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.430787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.431023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.431105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.431197] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1094.518388] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.518628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.518628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.518909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.519093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.534016] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1094.699752] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.700034] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.700217] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.700563] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.700865] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.701067] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.701217] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.701521] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.702077] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.702077] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.702403] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.702403] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.702403] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.702571] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.702752] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.702952] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.727945] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.728151] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.728275] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.728456] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.728902] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.729031] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.729127] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.729411] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.729551] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.874115] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.874318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.874395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.874573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.874666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.874862] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.874968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.875033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.875193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.875259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.875341] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be deleted. [ 1094.900633] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 in Status: SUCCESS [ 1094.900895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.901140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.901329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.901452] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.901579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.901631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.901821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.901994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.902048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.902110] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.908131] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.908284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.908327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.908671] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.908863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.908973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.232801] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.232801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.232801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.233123] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.233123] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.233259] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 not found, creating... [ 1095.233632] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.233849] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.233977] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.234244] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.234385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.234709] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.234938] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.235213] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.236280] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.236280] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.236280] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 is going to be created. [ 1095.270021] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.270021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.270021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.270021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.270021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.270021] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.405074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.405074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.405074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.405439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.405439] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.405537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.405591] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.405749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.405839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.405931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.406102] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.406211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.406268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.406399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.406580] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.406677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.406741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.407046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.407046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.407175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.407175] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.593475] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1095.593748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.593873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.594128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.594323] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.594471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.594623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.594812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.594896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.594993] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.910717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455: rpc.has_security_group_logging(os_id): False [ 1095.935019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.935019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.935019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.935019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.935599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.935599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.935599] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.935599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.935599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.935776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.935776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.935776] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 is going to be created. [ 1095.954846] env[66123]: INFO networking_nsxv3.common.synchronization [req-3f4a8394-28c3-4299-9d7e-4db12d5a4264 req-99d95219-624a-4ba7-bbbb-4c2a7242df26 service nova] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_rules [ 1095.954846] env[66123]: INFO networking_nsxv3.common.synchronization [req-3f4a8394-28c3-4299-9d7e-4db12d5a4264 req-99d95219-624a-4ba7-bbbb-4c2a7242df26 service nova] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 1095.954846] env[66123]: INFO networking_nsxv3.common.synchronization [req-3f4a8394-28c3-4299-9d7e-4db12d5a4264 req-99d95219-624a-4ba7-bbbb-4c2a7242df26 service nova] Enqueued Resource ID: 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 with Priority: HIGHEST for action port [ 1095.954846] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_rules [ 1095.954846] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 1095.954846] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 with Priority: HIGHEST for action port [ 1095.954846] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.954846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.954846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.955552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.955552] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.957989] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.958149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.958257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.958491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.959082] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.959082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.959082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.959082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.959669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.959669] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.961367] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.961367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.961367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.961367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.961367] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.013293] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.013498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.013578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.013881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.014159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.017287] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1096.017287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.047151] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 in Status: IN_PROGRESS for 2s [ 1096.097024] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.405744] env[66123]: INFO networking_nsxv3.common.synchronization [req-b84ea3af-fc0e-44e2-955a-68688275b0d6 req-7eac63df-9f03-44e3-9545-79ba88000f0d tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_members [ 1096.406300] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGHEST for action security_group_members [ 1096.406664] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.406781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.406994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.407069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.407228] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.407333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.407400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.407605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.407689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.407773] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.462503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.462653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.462902] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.467933] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 with status ACTIVE [ 1096.467933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.467933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.467933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.467933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.467933] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 is going to be updated. [ 1096.516893] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.516893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.516893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.516893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.516893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.516893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.554041] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1096.554041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.600557] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.909912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.909912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.909912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.910315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.936546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.936546] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.936546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.936546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.936546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.936546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.936546] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 is going to be updated. [ 1096.967955] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.968147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.968208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.968440] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.968678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.970122] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.979234] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 in Status: IN_PROGRESS for 2s [ 1097.105573] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.105775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.105853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.106119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.106199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.106274] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1097.139722] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.139873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.139940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.140178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.140327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.155121] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1097.472573] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.473066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.473066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.473066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.473293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.473477] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be created. [ 1097.509938] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.510174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.510225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.510433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.510598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.523557] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: UNINITIALIZED for 2s [ 1098.064496] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 in Status: SUCCESS [ 1098.064803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.990295] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 in Status: SUCCESS [ 1098.990687] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 deletion is rescheduled due to dependency. [ 1098.990687] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.173162] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1099.173399] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.173566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.173804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.174016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.174435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.174435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.174435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.174548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.174643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.174721] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.551066] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: SUCCESS [ 1099.551329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.551600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.551872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.552124] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.552299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.552391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.552583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.552674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.552764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.552856] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.678069] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.678069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.678069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.678069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.678069] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.678069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.678069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.678069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.678606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.678606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.678606] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.678606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.678606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.678793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.678830] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.678908] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.678959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.679118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.679211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.679327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.679447] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.055163] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.056445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.056445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.056445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.056693] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.056693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.056820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.056918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.057023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.057408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.057408] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.057408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.057563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.057678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.058210] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.058210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.058210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.058210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.058210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.058445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.058445] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.110891] env[66123]: INFO networking_nsxv3.common.synchronization [req-968988f4-1dcf-41b0-968b-9441c9173c91 req-4ad101dd-803e-4442-80ac-9eb634237089 tempest-ImagesTestJSON-261225348 tempest-ImagesTestJSON-261225348-project-member] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1100.111608] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGHEST for action security_group_members [ 1100.112011] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.112174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.112174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.112662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.112662] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.112662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.112840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.112840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.112921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.113043] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.182305] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 1100.203877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.204187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.204284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.204520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.204651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.204948] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.205103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.205288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.205407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.205491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.205726] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.205868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.205949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.206039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.206128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.206803] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.206803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.206803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.206803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.206803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.206803] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1100.287233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.287461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.287547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.287961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.288164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.307173] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1100.560769] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4: rpc.has_security_group_logging(os_id): False [ 1100.581254] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.581382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.581382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.581637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.581743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.581945] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.582142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.582142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.582288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.582364] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.582564] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.582662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.582724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.582870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.583078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.583331] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.583454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.583519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.583718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.583815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.583864] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be created. [ 1100.615596] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.617310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.617417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.617807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.617957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.618273] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.618428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.618552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.618830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.618929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.619066] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be updated. [ 1100.650318] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.650318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.650318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.650318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.650318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.653480] env[66123]: INFO networking_nsxv3.common.synchronization [req-02e9194f-2da0-4180-95f5-1c208496a70a req-ffd64048-5f05-4943-8263-86df13a67e8f tempest-AttachVolumeShelveTestJSON-2064503664 tempest-AttachVolumeShelveTestJSON-2064503664-project-member] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 1100.655073] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGHEST for action security_group_members [ 1100.655073] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.655073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.655073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.655312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.655351] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.655674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.655674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.655674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.655813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.655813] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.658796] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.658796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.658796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.658956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.659145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.663279] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: IN_PROGRESS for 2s [ 1100.669972] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: IN_PROGRESS for 2s [ 1101.160984] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.162333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.162333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.162572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.162572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.162835] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.162975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.162975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.163147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.163229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.163598] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b is going to be updated. [ 1101.192184] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.192385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.192385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.192610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.192755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.201093] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: IN_PROGRESS for 2s [ 1102.321481] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1102.321951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.680726] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 in Status: SUCCESS [ 1102.681146] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 deletion is rescheduled due to dependency. [ 1102.682063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.687331] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: SUCCESS [ 1102.687331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.149076] env[66123]: INFO networking_nsxv3.common.synchronization [req-5315170c-0a1e-4009-ba71-34fa96670cc6 req-a82d04fc-e1e3-444f-809c-b5b1427945c0 tempest-InstanceActionsNegativeTestJSON-1257969194 tempest-InstanceActionsNegativeTestJSON-1257969194-project-member] Enqueued Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_members [ 1103.149639] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGHEST for action security_group_members [ 1103.150257] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.150257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.150257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.150759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.150759] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.150836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.150886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.151064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.151161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.151514] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.337623] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92becbac-4b94-45df-b2f4-6067bd78d31b in Status: SUCCESS [ 1103.337623] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b deletion is rescheduled due to dependency. [ 1103.337903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.363251] env[66123]: INFO networking_nsxv3.common.synchronization [None req-6ba19607-c2f2-41f9-bb78-118e1f6072d7 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_rules [ 1103.363694] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_rules [ 1103.364051] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.364274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.364274] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.365024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.365024] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.450014] env[66123]: INFO networking_nsxv3.common.synchronization [None req-f758867a-f2e8-4420-8aaa-eea23ea6a30a tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_rules [ 1103.450965] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_rules [ 1103.451155] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.451301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.635252] env[66123]: INFO networking_nsxv3.common.synchronization [req-893096f2-5123-4b80-bd22-c067cdc6698c req-a6da210e-245a-4236-a0ca-7c40c782b42b tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1103.635822] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGHEST for action security_group_members [ 1103.636140] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.636262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.636327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.636521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.636764] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.636884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.636884] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.637053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.637136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.637226] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.653656] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.653892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.653892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.654081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.654170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.654497] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.654497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.654628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.654860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.655038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.655210] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 is going to be updated. [ 1103.682913] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.683083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.683198] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.683361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.683942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.694191] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 in Status: IN_PROGRESS for 2s [ 1103.886229] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.886380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.886450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.886748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.888111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.888111] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 already deleted. [ 1103.888321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.888597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.888778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.888866] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.139741] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.141075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.141075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.141075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.141075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.141075] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.141075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.141277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.141456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.141567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.141739] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be updated. [ 1104.169439] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.169439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.169439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.169439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.169439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.179919] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: IN_PROGRESS for 2s [ 1104.412370] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.412622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.412622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.412802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.412890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.412987] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 already deleted. [ 1104.413082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.253738] env[66123]: INFO networking_nsxv3.common.synchronization [req-808cb298-a56e-4589-bd5d-ce5af3f59193 req-b148217c-e15a-4e44-8fbd-d21ed1be41ee tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 1105.254388] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGHEST for action security_group_members [ 1105.254967] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.254967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.254967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.255759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.255759] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.255759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.255759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.256259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.256259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.256926] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.305832] env[66123]: INFO networking_nsxv3.common.synchronization [req-808cb298-a56e-4589-bd5d-ce5af3f59193 req-b148217c-e15a-4e44-8fbd-d21ed1be41ee tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 with Priority: HIGHEST for action port [ 1105.306413] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 with Priority: HIGHEST for action port [ 1105.306761] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.306885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.306954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.307173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.307254] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.704717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 in Status: SUCCESS [ 1105.704960] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 deletion is rescheduled due to dependency. [ 1105.705073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.758454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.758623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.758714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.758992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.759121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.759329] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.759430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.759492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.759688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.759731] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.759790] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be updated. [ 1105.787016] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.787191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.787298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.787479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.787629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.796711] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: IN_PROGRESS for 2s [ 1105.809266] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 with status ACTIVE [ 1105.809529] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.809707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.809769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.810036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.810141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.810336] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.810438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.810488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.810648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.810723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.810950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.811072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.811131] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.811294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.811365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.811451] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350 is going to be updated. [ 1105.833085] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.833295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.833295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.833596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.833748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.833916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-316a2cd5-43c8-45bf-8dc1-0b8ef9bd7350" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.173291] env[66123]: INFO networking_nsxv3.common.synchronization [req-df1ddcc8-2ba1-4a16-9808-6de764587a5d req-656d7225-456d-4c78-bb27-ebe5424a9705 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1106.173577] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1106.173940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.174098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.174182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.175509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.175509] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.175509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.175509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.175509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.175509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.175509] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.190988] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 in Status: SUCCESS [ 1106.190988] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 deletion is rescheduled due to dependency. [ 1106.190988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.679245] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.183606] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.337949] env[66123]: INFO networking_nsxv3.common.synchronization [req-50a1955a-a3a6-44af-9bfc-92baf7e464ee req-891ba743-4a37-4819-b36e-e114a0053492 tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1107.338540] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1107.338885] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.339030] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.339121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.339347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.339557] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.339710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.339808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.340058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.340163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.340263] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.681137] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.681137] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.681137] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.681137] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.681620] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.681871] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.682058] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.682346] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.682543] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.682800] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.683015] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.683204] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.683363] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.683517] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.683665] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.683861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.687030] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.687215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.687329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.687531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.687672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.687797] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1107.703761] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.703986] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.704461] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.704461] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-848" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.704710] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.704960] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.705096] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.705416] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.705548] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ef39dc-0c86-4afe-8ca2-72ef2d830e79',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.725129] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.725369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.725483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.725823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.726017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.735393] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1107.810906] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 in Status: SUCCESS [ 1107.811270] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 deletion is rescheduled due to dependency. [ 1107.811401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.843090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.843090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.843390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.843634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.843634] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.843844] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.843952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.844019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.844185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.844265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.844357] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1107.872967] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.872967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.872967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.872967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.872967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.886693] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1108.208390] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.208661] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.208737] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.209032] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.209189] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.209345] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 06ef39dc-0c86-4afe-8ca2-72ef2d830e79 not found, creating... [ 1108.209612] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.209896] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.209896] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.210116] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.210255] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.210536] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.210692] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.210859] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.211018] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.211154] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.211300] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 06ef39dc-0c86-4afe-8ca2-72ef2d830e79 is going to be created. [ 1108.231546] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.231772] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.231929] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.232199] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.232515] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.232759] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.929688] env[66123]: INFO networking_nsxv3.common.synchronization [req-50a1955a-a3a6-44af-9bfc-92baf7e464ee req-ed802a11-ad99-413f-8190-edd68272b2f4 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 1108.929872] env[66123]: INFO networking_nsxv3.common.synchronization [req-50a1955a-a3a6-44af-9bfc-92baf7e464ee req-ed802a11-ad99-413f-8190-edd68272b2f4 service nova] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1108.930060] env[66123]: INFO networking_nsxv3.common.synchronization [req-50a1955a-a3a6-44af-9bfc-92baf7e464ee req-ed802a11-ad99-413f-8190-edd68272b2f4 service nova] Enqueued Resource ID: 06ef39dc-0c86-4afe-8ca2-72ef2d830e79 with Priority: HIGHEST for action port [ 1108.930595] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_rules [ 1108.930733] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1108.930846] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06ef39dc-0c86-4afe-8ca2-72ef2d830e79 with Priority: HIGHEST for action port [ 1108.931150] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.931736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.931815] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.932048] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.932156] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.933085] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.933188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.933411] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.933526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.933580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.933774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.933845] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ef39dc-0c86-4afe-8ca2-72ef2d830e79',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.436029] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.436029] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.436394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06ef39dc-0c86-4afe-8ca2-72ef2d830e79 with status ACTIVE [ 1109.436430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.436544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.436617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.436916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.437040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.437224] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.437344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.437407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.437572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.437648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.437837] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.437928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.437977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.438155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.438247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.438349] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06ef39dc-0c86-4afe-8ca2-72ef2d830e79 is going to be updated. [ 1109.463576] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.463576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.463576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.463767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.463798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.464191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06ef39dc-0c86-4afe-8ca2-72ef2d830e79" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.746861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1109.747123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.900417] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1109.900417] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 1109.900417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.900417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.900417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.900417] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.900745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.900745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.900745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.900830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.900900] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.403018] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.906370] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.413495] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.413495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.413495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.413495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.413495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.413495] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1111.442365] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.442554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.442629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.442834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.443043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.458821] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1113.476609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.476609] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.476609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.476609] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.931520] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1113.931626] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1113.980951] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.981078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.981119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.981594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.981594] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.981706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.981706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.982191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.982191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.982191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.982302] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.982546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.982546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.982730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.983218] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.983218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.983218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.983336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.983336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.983398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.983480] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.351499] env[66123]: INFO networking_nsxv3.common.synchronization [None req-6922c0c8-6c83-4ed3-a535-681f6f80cc0f None None] Enqueued Resource ID: 8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469 with Priority: HIGHEST for action port [ 1114.352245] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469 with Priority: HIGHEST for action port [ 1114.354360] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.354505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.354505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.354849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.354914] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.489226] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b3e626-c03f-466a-b911-e8ab22cc99de: rpc.has_security_group_logging(os_id): False [ 1114.508339] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.510023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.510023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.510023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.510023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.510023] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.516174] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.516174] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.516174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.516174] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1114.593131] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.593649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.593649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.594566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.594566] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.611277] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1114.861328] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469 [ 1114.861634] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.861711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.861798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.861991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.862166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.864127] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469 already deleted. [ 1114.864127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5bf2b9-6d77-44b6-b6fe-ed8ea1617469" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.008414] env[66123]: INFO networking_nsxv3.common.synchronization [None req-817f9538-2e7a-40d3-abbc-dc3336179502 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1115.009225] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1115.009616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.009773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.011184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.011184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.011184] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.169027] env[66123]: INFO networking_nsxv3.common.synchronization [None req-de6cdd35-3cf5-4677-b051-624c49759a03 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1115.169320] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1115.169624] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.169720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.261828] env[66123]: INFO networking_nsxv3.common.synchronization [None req-8aa4ba10-a6d8-45ec-aa9a-29d08bfbc133 tempest-AttachInterfacesTestJSON-698492366 tempest-AttachInterfacesTestJSON-698492366-project-member] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1115.262252] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGHEST for action security_group_members [ 1115.262593] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.262730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.262817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.263063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.263339] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.264022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.264022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.264022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.264022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.264022] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.535625] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.535956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.535956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.536096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.536196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.536291] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca already deleted. [ 1115.536381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.536534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.536753] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.536804] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.766376] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.766655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.766737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.766992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.767105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.767318] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.767422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.767485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.767640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.767717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.767819] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be updated. [ 1115.801635] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.802371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.802371] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.802863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.803083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.812843] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: IN_PROGRESS for 2s [ 1116.061732] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.061893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.061988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.062492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.062617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.062746] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca already deleted. [ 1116.062814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.626617] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1116.627047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.724405] env[66123]: INFO networking_nsxv3.common.synchronization [None req-c5a320a7-b202-4302-94d2-c4b52b7662cc None None] Enqueued Resource ID: c1352a39-90f2-4f43-8388-92bab1348027 with Priority: HIGHEST for action port [ 1116.724953] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1352a39-90f2-4f43-8388-92bab1348027 with Priority: HIGHEST for action port [ 1116.725280] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1352a39-90f2-4f43-8388-92bab1348027 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.725396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1352a39-90f2-4f43-8388-92bab1348027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.725464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1352a39-90f2-4f43-8388-92bab1348027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.725716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1352a39-90f2-4f43-8388-92bab1348027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.726311] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1352a39-90f2-4f43-8388-92bab1348027',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.228898] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1352a39-90f2-4f43-8388-92bab1348027 [ 1117.229794] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.229794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.229794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.229794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.229794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.230151] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1352a39-90f2-4f43-8388-92bab1348027 already deleted. [ 1117.230151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1352a39-90f2-4f43-8388-92bab1348027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.827916] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 in Status: SUCCESS [ 1117.828287] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 deletion is rescheduled due to dependency. [ 1117.828287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.159913] env[66123]: INFO networking_nsxv3.common.synchronization [req-e711a105-a1c1-4e62-86eb-dfe9206624fc req-73a06a7c-b29b-4132-9e8c-8be03dfce265 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_members [ 1118.161700] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_members [ 1118.163704] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.163845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.163916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.164200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.164357] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.164878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.164878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.164878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.164878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.164878] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.670473] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.670632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.671709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.671709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.671709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.671709] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.671709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.671709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.671709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.672039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.672039] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 already deleted. [ 1118.672039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.851813] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.852168] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.852213] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.852460] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.852719] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.852877] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.852992] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.853248] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.853391] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.853597] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.853708] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.853811] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.853914] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.854030] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.854133] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.854261] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.873307] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.873583] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.873795] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.873975] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.874355] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.874593] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.874788] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.875124] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.875525] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6606d1c-2a59-4c1a-8a30-9b380ac997fc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.377605] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.377895] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.378629] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.378629] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.378782] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.379046] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port b6606d1c-2a59-4c1a-8a30-9b380ac997fc not found, creating... [ 1119.379460] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.379691] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.379830] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.380175] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.380318] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.380638] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.380794] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.380904] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.382596] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.382596] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.382596] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: b6606d1c-2a59-4c1a-8a30-9b380ac997fc is going to be created. [ 1119.404973] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.405413] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.405549] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.409338] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.411632] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.412311] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.832272] env[66123]: INFO networking_nsxv3.common.synchronization [None req-bffe28c1-ce2d-43e0-8193-06ba8e49e61d tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_rules [ 1119.832545] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_rules [ 1119.832918] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.833089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.833185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.833468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.833582] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.059807] env[66123]: INFO networking_nsxv3.common.synchronization [None req-51adc671-498f-4ca3-aba3-c9d970ccf46e tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_rules [ 1120.060362] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_rules [ 1120.060665] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.060767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.234188] env[66123]: INFO networking_nsxv3.common.synchronization [req-e711a105-a1c1-4e62-86eb-dfe9206624fc req-e5678ea9-942b-40f4-ac65-87b706c56a4d service nova] Enqueued Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_rules [ 1120.234307] env[66123]: INFO networking_nsxv3.common.synchronization [req-e711a105-a1c1-4e62-86eb-dfe9206624fc req-e5678ea9-942b-40f4-ac65-87b706c56a4d service nova] Enqueued Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_members [ 1120.234460] env[66123]: INFO networking_nsxv3.common.synchronization [req-e711a105-a1c1-4e62-86eb-dfe9206624fc req-e5678ea9-942b-40f4-ac65-87b706c56a4d service nova] Enqueued Resource ID: b6606d1c-2a59-4c1a-8a30-9b380ac997fc with Priority: HIGHEST for action port [ 1120.234955] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_rules [ 1120.235263] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_members [ 1120.235414] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6606d1c-2a59-4c1a-8a30-9b380ac997fc with Priority: HIGHEST for action port [ 1120.235706] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.235775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.235891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.236058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.236142] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.237022] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.237189] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.237257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.237413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.237558] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.238296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.238296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.238296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.238296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.238296] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.238795] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.239242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.239242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.239242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.239242] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6606d1c-2a59-4c1a-8a30-9b380ac997fc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.357034] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.357034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.357034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.357254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.357776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.357776] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 already deleted. [ 1120.357776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.357776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.357958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.357958] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.742395] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.743485] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.743620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.743776] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6606d1c-2a59-4c1a-8a30-9b380ac997fc with status ACTIVE [ 1120.743917] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.744036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.744093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.744756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.744756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.744756] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.744756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.744756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.744962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.744962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.745464] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.745464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.745464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.745464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.745644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.745644] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6606d1c-2a59-4c1a-8a30-9b380ac997fc is going to be updated. [ 1120.768568] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.768691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.768729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.768958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.769169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.769353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6606d1c-2a59-4c1a-8a30-9b380ac997fc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.882109] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.882267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.882352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.882549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.882626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.882737] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 already deleted. [ 1120.882882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.248172] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.750340] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.750550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.750677] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.750923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.751111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.751188] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 is going to be created. [ 1121.774695] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.774897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.774949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.775294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.775380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.786831] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2e724f-df49-49d1-bc73-5c8b240073d7 in Status: UNINITIALIZED for 2s [ 1123.798215] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2e724f-df49-49d1-bc73-5c8b240073d7 in Status: SUCCESS [ 1123.798509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.798569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.798788] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.798978] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.799112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.799186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.799375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.799453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.799539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.799630] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.302102] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.758266] env[66123]: INFO networking_nsxv3.common.synchronization [req-7cee12bd-70c7-4717-8d9b-78220eb00112 req-9ee893e5-4066-4bd3-a98a-4ab02950a106 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1124.758266] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1124.758266] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.758266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.758266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.758266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.758266] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.758266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.758266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.758266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.758952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.758952] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.805812] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df2e724f-df49-49d1-bc73-5c8b240073d7: rpc.has_security_group_logging(os_id): False [ 1124.823958] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.824206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.824265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.824531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.824640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.824957] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.825095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.825158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.825333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.825416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.825586] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 is going to be created. [ 1124.900277] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.900461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.900542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.901185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.901185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.913944] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df2e724f-df49-49d1-bc73-5c8b240073d7 in Status: IN_PROGRESS for 2s [ 1125.145640] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.145816] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-118" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.147585] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-118" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.147585] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-118" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.147585] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.147789] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.148051] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.148383] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.148562] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.148816] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.148973] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.149106] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.149266] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.149413] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.149617] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.149856] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.171718] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.171718] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.171718] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.171964] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-118" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.172256] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.172464] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.172600] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.172961] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.173178] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8183225b-bb0e-4ae3-928f-6f5fb2af07a1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.260877] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.261126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.261233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.261528] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.261655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.261931] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.262083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.262177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.262383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.262491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.262592] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca already deleted. [ 1125.262680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.676095] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.677048] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.677304] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.677627] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.677787] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.677968] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 not found, creating... [ 1125.678274] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.678435] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.678548] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.678780] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.678918] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.679215] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.679367] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.679481] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.679681] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.679812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.679968] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 is going to be created. [ 1125.700775] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.701022] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.701185] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.701470] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.701801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.702120] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.416644] env[66123]: INFO networking_nsxv3.common.synchronization [req-7cee12bd-70c7-4717-8d9b-78220eb00112 req-8554a154-17df-488a-a560-6aba0854c4f9 service nova] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1126.416897] env[66123]: INFO networking_nsxv3.common.synchronization [req-7cee12bd-70c7-4717-8d9b-78220eb00112 req-8554a154-17df-488a-a560-6aba0854c4f9 service nova] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1126.417077] env[66123]: INFO networking_nsxv3.common.synchronization [req-7cee12bd-70c7-4717-8d9b-78220eb00112 req-8554a154-17df-488a-a560-6aba0854c4f9 service nova] Enqueued Resource ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with Priority: HIGHEST for action port [ 1126.417200] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1126.417336] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1126.417434] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with Priority: HIGHEST for action port [ 1126.417985] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.418977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.418977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.418977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.418977] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.420469] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.420654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.420734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.420914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.421084] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.421185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.421249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.421397] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.421483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.421569] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.422504] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.423225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.423225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.423225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.423225] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8183225b-bb0e-4ae3-928f-6f5fb2af07a1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.924966] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.925108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.925311] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.927036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df2e724f-df49-49d1-bc73-5c8b240073d7 in Status: SUCCESS [ 1126.927130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.927272] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with status ACTIVE [ 1126.927454] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.927564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.927627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.927820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.927906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.928156] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.928264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.928328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.928492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.928569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.928750] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.928844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.928906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.929064] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.929140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.929224] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 is going to be updated. [ 1126.957213] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.957428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.957428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.957622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.957757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.957922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.431982] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.934029] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.934217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.934262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.934491] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.934583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.934685] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be created. [ 1127.957969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.958208] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.958259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.958453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.958633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.969042] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: UNINITIALIZED for 2s [ 1129.476173] env[66123]: INFO networking_nsxv3.common.synchronization [req-47ede10c-294c-488d-b776-e24ecc800450 req-fb402089-b5e5-415c-a12b-1784b93f96cf tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1129.476708] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1129.477072] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.477199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.477270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.477481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.477629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.477725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.477814] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.477926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.478023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.478211] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.857255] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-666 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.857473] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.857585] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.857873] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.858200] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.858366] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.858481] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.858709] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.858858] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.859081] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.859211] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.859353] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.859463] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.859616] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.859731] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.859889] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.878394] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.878569] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1129.878707] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.878882] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-666" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.882054] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-6a540315-601a-4fe0-a046-cbe0f0225e10 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.882054] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.882054] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.882253] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.882286] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a540315-601a-4fe0-a046-cbe0f0225e10',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.980116] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: SUCCESS [ 1129.981034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.981034] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.981859] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.983616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.983616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.983616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.983616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.983616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.983616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.983616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.983616] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.384729] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.385083] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.385228] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.385651] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.385819] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.385987] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 6a540315-601a-4fe0-a046-cbe0f0225e10 not found, creating... [ 1130.386357] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.386561] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.386700] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.387123] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.387452] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.387876] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.388052] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.388193] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.388412] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.388546] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.388685] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 6a540315-601a-4fe0-a046-cbe0f0225e10 is going to be created. [ 1130.411661] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.411828] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.412194] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.412318] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.412637] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.412982] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.486677] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.488028] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.990038] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.990224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.990305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.990585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.990695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.990820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1130.992183] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca: rpc.has_security_group_logging(os_id): False [ 1131.013141] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.013141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.013248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.013551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.013708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.014154] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.014369] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.014503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.014839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.014882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.015011] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be created. [ 1131.024969] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.025152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.025152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.025414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.025635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.034652] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1131.076315] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.077241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.077241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.077241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.077241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.091488] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: IN_PROGRESS for 2s [ 1131.136720] env[66123]: INFO networking_nsxv3.common.synchronization [req-47ede10c-294c-488d-b776-e24ecc800450 req-9f355553-a7b5-4ff4-8090-bf03503564b2 service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 1131.136720] env[66123]: INFO networking_nsxv3.common.synchronization [req-47ede10c-294c-488d-b776-e24ecc800450 req-9f355553-a7b5-4ff4-8090-bf03503564b2 service nova] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1131.136720] env[66123]: INFO networking_nsxv3.common.synchronization [req-47ede10c-294c-488d-b776-e24ecc800450 req-9f355553-a7b5-4ff4-8090-bf03503564b2 service nova] Enqueued Resource ID: 6a540315-601a-4fe0-a046-cbe0f0225e10 with Priority: HIGHEST for action port [ 1131.137304] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_rules [ 1131.137479] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1131.137641] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a540315-601a-4fe0-a046-cbe0f0225e10 with Priority: HIGHEST for action port [ 1131.138452] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.138621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.138746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.138925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.139023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.141632] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.141736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.141941] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a540315-601a-4fe0-a046-cbe0f0225e10 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.142985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.143126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.143380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.143466] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a540315-601a-4fe0-a046-cbe0f0225e10',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.645712] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a540315-601a-4fe0-a046-cbe0f0225e10 with status ACTIVE [ 1131.646044] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.646106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.646176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.646396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.646497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.646683] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.646783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.646845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.647052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.647166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.647378] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.647476] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.647537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.647706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.647817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.647871] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a540315-601a-4fe0-a046-cbe0f0225e10 is going to be updated. [ 1131.649065] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.649178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.668324] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.668498] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.668539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.668726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.668870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.669055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a540315-601a-4fe0-a046-cbe0f0225e10" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.883372] env[66123]: INFO networking_nsxv3.common.synchronization [req-5bb29509-ee41-42d6-9695-dbac9176e492 req-91577ba4-02c1-42a2-b780-66aed0dc6455 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_members [ 1131.884480] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_members [ 1131.885024] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.885024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.885401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.885401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.885679] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.885849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.885948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.886200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.886349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.886465] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.257368] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.257583] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.257669] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.258559] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.258559] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.258559] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.258723] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.258791] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.258930] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.259180] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.259296] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.259400] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.259504] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.259610] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.259710] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.259835] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.278197] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.278368] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.278518] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.279287] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.279287] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-b2b7fdac-fbfc-466a-a289-988519d3c13f taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.279287] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.279287] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.279712] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.279758] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b7fdac-fbfc-466a-a289-988519d3c13f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.389057] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.389207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.389302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.389504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.389597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.389792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.389909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.389969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.390163] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.390239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.390325] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 already deleted. [ 1132.390407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.782025] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.782423] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.782423] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.782613] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.782774] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.782929] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port b2b7fdac-fbfc-466a-a289-988519d3c13f not found, creating... [ 1132.783196] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.783353] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.783470] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.783749] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.783886] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.784182] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.784330] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.784445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.784648] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.784779] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.784932] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: b2b7fdac-fbfc-466a-a289-988519d3c13f is going to be created. [ 1132.806204] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.806427] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.806549] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.806842] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.807153] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.807403] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.045509] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1133.045846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.046106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.046412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.046663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.046844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.046934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.047276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.047457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.047599] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.106498] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: SUCCESS [ 1133.106636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.550158] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.562786] env[66123]: INFO networking_nsxv3.common.synchronization [req-5bb29509-ee41-42d6-9695-dbac9176e492 req-4d3fbf37-fa34-4420-8af5-38f17c845bca service nova] Enqueued Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_rules [ 1133.562786] env[66123]: INFO networking_nsxv3.common.synchronization [req-5bb29509-ee41-42d6-9695-dbac9176e492 req-4d3fbf37-fa34-4420-8af5-38f17c845bca service nova] Enqueued Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_members [ 1133.562970] env[66123]: INFO networking_nsxv3.common.synchronization [req-5bb29509-ee41-42d6-9695-dbac9176e492 req-4d3fbf37-fa34-4420-8af5-38f17c845bca service nova] Enqueued Resource ID: b2b7fdac-fbfc-466a-a289-988519d3c13f with Priority: HIGHEST for action port [ 1133.564101] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_rules [ 1133.564101] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_members [ 1133.564101] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2b7fdac-fbfc-466a-a289-988519d3c13f with Priority: HIGHEST for action port [ 1133.564386] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.565697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.565697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.565697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.565697] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.565697] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.566023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.566023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.566023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.566172] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.566257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.566309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.566453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.566587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.566627] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.567486] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2b7fdac-fbfc-466a-a289-988519d3c13f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.569129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.569129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.569129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.569129] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b7fdac-fbfc-466a-a289-988519d3c13f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.052882] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.071602] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.071602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.071602] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.072789] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2b7fdac-fbfc-466a-a289-988519d3c13f with status ACTIVE [ 1134.072789] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.072789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.072789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.073021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.073061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.073238] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.073412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.073412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.073565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.073605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.073782] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.073864] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.074430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.074430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.074430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.074430] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2b7fdac-fbfc-466a-a289-988519d3c13f is going to be updated. [ 1134.098692] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.098894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.098977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.099203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.099739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.099739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2b7fdac-fbfc-466a-a289-988519d3c13f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.554967] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.555195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.555269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.555501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.555593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.555772] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1134.576610] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.584850] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.585012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.585164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.585319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.585461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.596014] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1135.079400] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.080303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.080303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.080439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.080532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.080617] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 is going to be created. [ 1135.104019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.104173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.104239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.104452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.104613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.118280] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 in Status: UNINITIALIZED for 2s [ 1136.606814] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1136.607132] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.607332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.607517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.607719] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.607881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.607933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.608084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.608201] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.608302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.608392] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.110850] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.111113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.111113] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.111301] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.111470] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.111572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.111637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.111792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.111885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.111974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.112144] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.112239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.112300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.112442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.112579] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.112669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.112729] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.112865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.112939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.113039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.113129] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.128019] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 in Status: SUCCESS [ 1137.128255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.128407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.128613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.128798] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.128907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.129020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.129155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.129235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.129319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.129417] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.615867] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a920e51b-9550-463b-b158-782df4ef60d2: rpc.has_security_group_logging(os_id): False [ 1137.631189] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.636514] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.636697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.637327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.637327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.637327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.637636] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.637636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.637636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.637836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.637889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.638294] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.638294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.638462] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.638513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.638608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.638808] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.638941] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.639023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.639174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.639247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.639364] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1137.710097] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.710401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.710518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.710845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.711119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.730180] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1138.133784] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bc5413e-0daf-404c-8ccc-94e28756a174: rpc.has_security_group_logging(os_id): False [ 1138.153441] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.153607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.153644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.153866] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.154019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.155214] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.155365] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.155450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.155637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.155738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.155860] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 is going to be created. [ 1138.224882] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.224882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.224882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.224882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.224882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.242348] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 in Status: IN_PROGRESS for 2s [ 1138.566438] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1138.566438] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1139.746861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1139.747242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.255382] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 in Status: SUCCESS [ 1140.255593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.753138] env[66123]: INFO networking_nsxv3.common.synchronization [req-1e328976-724c-485f-ade9-8df981a34fc9 req-21531bf4-4cc7-4650-a3da-a3ad2de63298 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1140.757018] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1140.757018] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.757018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.757018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.757018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.757018] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.757018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.757018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.757018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.757018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.757018] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.259557] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.259811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.259938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.260304] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.260463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.260778] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.260953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.261083] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.261339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.261463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.261600] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1141.296300] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.296499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.296544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.296770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.296927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.308281] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1141.948964] env[66123]: INFO networking_nsxv3.common.synchronization [req-81783887-9c38-46ce-841d-2f002cf03e24 req-a7dc91f9-a6a8-418d-aa1f-a22c345b9bfb tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1141.949629] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1141.949977] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.950134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.950299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.950429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.950606] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.950714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.950782] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.950970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.951067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.951165] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.315981] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.316942] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.316942] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.316942] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.316942] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.317324] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.317324] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.317717] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.317791] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.317963] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.318755] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.318755] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.318755] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.318755] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.318755] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.318755] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.340944] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.341126] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.341278] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.341474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-846" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.341830] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.341977] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.342135] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.342662] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.342890] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24b54ee9-c320-42b0-b92e-8ec41b6e5e9b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.454113] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.846415] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.846653] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.846812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.847192] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.847346] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.847499] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 24b54ee9-c320-42b0-b92e-8ec41b6e5e9b not found, creating... [ 1142.847776] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.847924] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.848057] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.848445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.848641] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.849575] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.849575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.849575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.849575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.849758] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.849758] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 24b54ee9-c320-42b0-b92e-8ec41b6e5e9b is going to be created. [ 1142.879507] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.879919] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.880124] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.880544] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.880843] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.881140] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.955503] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.321561] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1143.321809] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 1143.321967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.458595] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.458747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.458824] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.459159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.459159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.459263] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be updated. [ 1143.496087] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.496258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.496351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.496603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.496799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.508167] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: IN_PROGRESS for 2s [ 1143.602616] env[66123]: INFO networking_nsxv3.common.synchronization [req-81783887-9c38-46ce-841d-2f002cf03e24 req-945af6fe-c6e0-437e-872c-a84fbebb353e service nova] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 1143.602817] env[66123]: INFO networking_nsxv3.common.synchronization [req-81783887-9c38-46ce-841d-2f002cf03e24 req-945af6fe-c6e0-437e-872c-a84fbebb353e service nova] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1143.603010] env[66123]: INFO networking_nsxv3.common.synchronization [req-81783887-9c38-46ce-841d-2f002cf03e24 req-945af6fe-c6e0-437e-872c-a84fbebb353e service nova] Enqueued Resource ID: 24b54ee9-c320-42b0-b92e-8ec41b6e5e9b with Priority: HIGHEST for action port [ 1143.603657] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_rules [ 1143.603866] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1143.604014] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24b54ee9-c320-42b0-b92e-8ec41b6e5e9b with Priority: HIGHEST for action port [ 1143.604482] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.604683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.604942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.605432] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.605432] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.606631] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.606761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.606974] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.607090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.607207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.607524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.607614] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24b54ee9-c320-42b0-b92e-8ec41b6e5e9b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.110710] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.110710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.114773] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24b54ee9-c320-42b0-b92e-8ec41b6e5e9b with status ACTIVE [ 1144.114773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.114773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.114773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.114773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.114773] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24b54ee9-c320-42b0-b92e-8ec41b6e5e9b is going to be updated. [ 1144.135628] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.135628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.135628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.135898] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.136244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.136244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24b54ee9-c320-42b0-b92e-8ec41b6e5e9b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.311859] env[66123]: INFO networking_nsxv3.common.synchronization [req-29f978ec-36fa-47e3-98fc-f8c2bfb0faf5 req-2012aed4-ca44-4a7d-8813-c0c92366d2d2 tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1144.312425] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1144.312773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.312903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.312972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.313504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.313731] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.314059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.314213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.315331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.315492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.315628] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.659960] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.660196] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.660320] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.660590] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.660839] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.660992] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.661275] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.661533] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.661680] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.661898] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.662022] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.662128] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.662234] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.662355] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.662543] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.663141] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.682009] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.682225] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1144.682364] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.682610] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-856" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.682925] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.683110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.683227] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.683562] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.683699] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f60ecb21-c4c5-4f14-b6a7-c27e4dd82847',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.818662] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.819031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.819204] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.819527] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.820175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.820488] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.824229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.824229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.824229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.824229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.824229] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1144.846950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.847108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.847212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.847451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.847590] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.857451] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1145.186673] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.187042] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.187042] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.187385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.187547] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.187708] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 not found, creating... [ 1145.187978] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.188153] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.188302] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.188536] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.188674] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.189058] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.189148] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.189251] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.189455] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.189585] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.189724] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 is going to be created. [ 1145.208968] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.209245] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.209418] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.209855] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.210134] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.210367] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.519068] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: SUCCESS [ 1145.519314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.519542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.519811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.520188] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.520314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.520370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.520536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.520619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.520716] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.953322] env[66123]: INFO networking_nsxv3.common.synchronization [req-29f978ec-36fa-47e3-98fc-f8c2bfb0faf5 req-31c2b3b8-b976-4970-a4fd-0c76921ed3b5 service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 1145.954922] env[66123]: INFO networking_nsxv3.common.synchronization [req-29f978ec-36fa-47e3-98fc-f8c2bfb0faf5 req-31c2b3b8-b976-4970-a4fd-0c76921ed3b5 service nova] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1145.954922] env[66123]: INFO networking_nsxv3.common.synchronization [req-29f978ec-36fa-47e3-98fc-f8c2bfb0faf5 req-31c2b3b8-b976-4970-a4fd-0c76921ed3b5 service nova] Enqueued Resource ID: f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 with Priority: HIGHEST for action port [ 1145.954922] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_rules [ 1145.954922] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1145.954922] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 with Priority: HIGHEST for action port [ 1145.954922] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.954922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.954922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.956915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.957062] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.958519] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.958632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.958871] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.958978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.959105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.959265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.959375] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f60ecb21-c4c5-4f14-b6a7-c27e4dd82847',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.023941] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.335825] env[66123]: INFO networking_nsxv3.common.synchronization [req-25c3827a-701c-417b-b18a-5064b8bec6e1 req-c032d9a1-a54a-4587-90e4-1d6c96a3aca8 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1146.336433] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1146.336776] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.336897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.336962] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.338041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.338041] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.338041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.338041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.338041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.338041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.338041] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.462718] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 with status ACTIVE [ 1146.462998] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.463155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.463228] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.463455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.463548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.463735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.463836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.463897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.464123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.464221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.464528] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.464654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.464755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.464966] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.465072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.465201] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f60ecb21-c4c5-4f14-b6a7-c27e4dd82847 is going to be updated. [ 1146.466728] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.466728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.497352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.497545] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.497583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.497813] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.497957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.498144] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f60ecb21-c4c5-4f14-b6a7-c27e4dd82847" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.525788] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.840714] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.867830] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1146.868014] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 1146.868139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.868747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.868978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.869328] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.869328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.869445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.869569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.869652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.869725] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.029274] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.029448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.029520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.029737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.029831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.032054] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be updated. [ 1147.061836] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.061981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.062077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.062333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.062803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.072022] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: IN_PROGRESS for 2s [ 1147.343449] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.373134] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.848249] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.848249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.848249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.848249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.848249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.848249] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1147.874768] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.882033] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.882033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.882033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.882033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.882033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.898743] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1148.378068] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.378068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.378068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.378068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.378068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.378633] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1148.418925] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.419202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.419202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.419323] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.419482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.429901] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1149.089889] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: SUCCESS [ 1149.090221] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.090465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.090741] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.090962] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.091121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.091209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.091398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.091518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.091627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.091739] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.593905] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.911702] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1149.911702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.095833] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d200e885-c7ad-4101-b6e0-e3026ae4d35f: rpc.has_security_group_logging(os_id): False [ 1150.113093] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.113245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.113321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.113541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.132248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.132550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.132669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.132736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.132935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.133092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.133141] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be updated. [ 1150.200460] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.200663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.200705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.200899] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.201053] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.416485] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: IN_PROGRESS for 2s [ 1150.449093] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1150.449328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.449513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.449758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.449944] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.450080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.450170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.450414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.450529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.450633] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.450745] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.953267] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.953521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.953612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.953914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.954113] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.954233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.954418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.954540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.954629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.954722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.954869] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.954963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.955056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.955257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.955427] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.955568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.955698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.955915] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.956010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.956766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.956957] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.338145] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1151.338145] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1151.460695] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9172499c-e925-4db8-91df-db6b7bc0f5c2: rpc.has_security_group_logging(os_id): False [ 1151.485370] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.485370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.485370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.485370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.485370] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.485582] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.485582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.485657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.485993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.485993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.486217] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.486217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.486217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.486314] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.486391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.486575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.486665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.486724] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.486861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.486934] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.487079] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1151.567808] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.567935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.567976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.568194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.568357] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.585433] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1152.431032] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: SUCCESS [ 1152.431032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.607865] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1153.607865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.643685] env[66123]: INFO networking_nsxv3.common.synchronization [req-7d47593e-a7bc-4070-b8d6-d7775f2b2a74 req-865e2885-5fb2-4ad5-a93c-fec20cdc3cab tempest-DeleteServersTestJSON-1517631462 tempest-DeleteServersTestJSON-1517631462-project-member] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1155.644815] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGHEST for action security_group_members [ 1155.645442] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.645666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.645763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.646031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.646780] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.646943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.647074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.647353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.647530] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.647696] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.113018] env[66123]: INFO networking_nsxv3.common.synchronization [req-f372228d-a7da-46a2-8c47-968c13474b48 req-85fb4535-d0e0-4741-8b42-554ee6da3c53 tempest-ServersTestJSON-1216186375 tempest-ServersTestJSON-1216186375-project-member] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1156.113648] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGHEST for action security_group_members [ 1156.114031] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.114175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.114245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.114481] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.114675] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.114795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.114895] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.115173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.115320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.115421] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.151796] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.152130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.152211] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.152484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.152524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.152720] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.152822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.152887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.153106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.153187] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.153276] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be updated. [ 1156.187114] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.187438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.187556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.187825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.188038] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.203028] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 2s [ 1156.618220] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.618445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.618445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.618779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.618907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.619152] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.619327] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.619429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.619722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.619827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.619941] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be updated. [ 1156.647265] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.647601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.647601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.647780] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.647956] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.659175] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: IN_PROGRESS for 2s [ 1156.871643] env[66123]: INFO networking_nsxv3.common.synchronization [req-78e26c01-4d0c-490e-ae86-b3e8aceffb38 req-092714c1-86c1-454f-862a-41c5f408889b tempest-ServerDiskConfigTestJSON-307640404 tempest-ServerDiskConfigTestJSON-307640404-project-member] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1156.872206] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGHEST for action security_group_members [ 1156.872614] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.872734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.872802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.873028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.873181] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.873284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.873348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.873510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.873595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.873688] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.377071] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.377300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.377408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.377654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.377749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.377963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.378071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.378130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.378339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.378429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.378480] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be updated. [ 1157.407152] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.407414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.407414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.407672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.407825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.418345] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: IN_PROGRESS for 2s [ 1158.213828] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: IN_PROGRESS for 4s [ 1158.671402] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a920e51b-9550-463b-b158-782df4ef60d2 in Status: SUCCESS [ 1158.671682] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a920e51b-9550-463b-b158-782df4ef60d2 deletion is rescheduled due to dependency. [ 1158.671844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.428742] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 in Status: SUCCESS [ 1159.429103] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 deletion is rescheduled due to dependency. [ 1159.429103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.226650] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b3e626-c03f-466a-b911-e8ab22cc99de in Status: SUCCESS [ 1160.227052] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de deletion is rescheduled due to dependency. [ 1160.227052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.874308] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.874308] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1162.843941] env[66123]: INFO networking_nsxv3.common.synchronization [req-7c74d087-9cdb-4722-a218-3f8dda923a36 req-03518d01-4367-46af-843b-d7c87489cb88 tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1162.843941] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1162.844803] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.844803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.844803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.844972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.845161] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.845306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.845426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.846074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.846157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.846196] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.349269] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.349570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.349570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.349736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.349825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.350041] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.351689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.351689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.351689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.351689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.351689] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1163.380702] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.380945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.381034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.381325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.381482] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.392176] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1165.404967] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1165.405255] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 deletion is rescheduled due to dependency. [ 1165.405294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.845401] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.845767] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1167.932184] env[66123]: INFO networking_nsxv3.common.synchronization [None req-0bb6ee4a-19e4-4cd4-9a35-7a814b88de2e None None] Enqueued Resource ID: ba9f8fa8-cc31-495e-bb35-c5272b174521 with Priority: HIGHEST for action port [ 1167.932720] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9f8fa8-cc31-495e-bb35-c5272b174521 with Priority: HIGHEST for action port [ 1167.933034] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba9f8fa8-cc31-495e-bb35-c5272b174521 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.933209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba9f8fa8-cc31-495e-bb35-c5272b174521" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.933209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba9f8fa8-cc31-495e-bb35-c5272b174521" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.933483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba9f8fa8-cc31-495e-bb35-c5272b174521" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.933824] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba9f8fa8-cc31-495e-bb35-c5272b174521',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.436617] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba9f8fa8-cc31-495e-bb35-c5272b174521 [ 1168.436853] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.436987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.437073] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.437352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.437445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.437513] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba9f8fa8-cc31-495e-bb35-c5272b174521 already deleted. [ 1168.437589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba9f8fa8-cc31-495e-bb35-c5272b174521" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.935617] env[66123]: INFO networking_nsxv3.common.synchronization [None req-1935ba0b-1834-4721-81e6-356f793d77ff None None] Enqueued Resource ID: fc579df2-6a12-40eb-8d7e-f64b9566babe with Priority: HIGHEST for action port [ 1169.936246] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc579df2-6a12-40eb-8d7e-f64b9566babe with Priority: HIGHEST for action port [ 1169.936648] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc579df2-6a12-40eb-8d7e-f64b9566babe taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.936791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc579df2-6a12-40eb-8d7e-f64b9566babe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.936863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc579df2-6a12-40eb-8d7e-f64b9566babe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.939589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc579df2-6a12-40eb-8d7e-f64b9566babe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.939685] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc579df2-6a12-40eb-8d7e-f64b9566babe',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.442337] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc579df2-6a12-40eb-8d7e-f64b9566babe [ 1170.442665] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.442841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.442945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.443177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.443271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.443369] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc579df2-6a12-40eb-8d7e-f64b9566babe already deleted. [ 1170.443453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc579df2-6a12-40eb-8d7e-f64b9566babe" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.262139] env[66123]: INFO networking_nsxv3.common.synchronization [req-3dca8764-58f8-4276-bf19-c661ca8d24a2 req-41abcddd-222a-4ce5-b6fd-7fbc92ac126d tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1171.262139] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1171.262139] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.262139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.262139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.263689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.264014] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.264252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.264479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.264772] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.264968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.265156] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.591176] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.591376] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.591500] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.591794] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.592137] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.592325] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.592455] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.592681] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.592830] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.593048] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.593164] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.593274] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.593377] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.593485] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.593591] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.593725] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.614867] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.615068] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1171.615211] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.615384] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.615801] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-0e3c62b6-dc0f-4f48-9391-38b01db16793 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.615989] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.616124] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.616438] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.616574] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3c62b6-dc0f-4f48-9391-38b01db16793',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.767965] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.768154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.768244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.768554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.768673] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.768894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.768996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.769071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.769231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.769312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.769396] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1171.796225] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.796391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.796464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.796680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.796820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.805718] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1172.118870] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.119311] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.119468] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.119780] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.119953] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.120129] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 0e3c62b6-dc0f-4f48-9391-38b01db16793 not found, creating... [ 1172.120414] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.120664] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.120786] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.121202] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.121202] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.121465] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.121646] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.121819] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.122052] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.122206] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.122349] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 is going to be created. [ 1172.142588] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.142778] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.142861] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.143171] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.143400] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.143630] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.639963] env[66123]: INFO networking_nsxv3.common.synchronization [req-24cc5dde-ea67-4253-bdc9-055baabf954a req-b4fd6dc7-d0d0-488e-b018-106b2f9307d7 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1172.642040] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1172.642040] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.642040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.642040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.642040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.642320] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.642361] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.642446] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.642649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.642776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.642911] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.662618] env[66123]: INFO networking_nsxv3.common.synchronization [req-24cc5dde-ea67-4253-bdc9-055baabf954a req-b4fd6dc7-d0d0-488e-b018-106b2f9307d7 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1172.662793] env[66123]: INFO networking_nsxv3.common.synchronization [req-24cc5dde-ea67-4253-bdc9-055baabf954a req-b4fd6dc7-d0d0-488e-b018-106b2f9307d7 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1172.662926] env[66123]: INFO networking_nsxv3.common.synchronization [req-24cc5dde-ea67-4253-bdc9-055baabf954a req-b4fd6dc7-d0d0-488e-b018-106b2f9307d7 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with Priority: HIGHEST for action port [ 1172.663420] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1172.663553] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1172.664779] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with Priority: HIGHEST for action port [ 1172.664779] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.664779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.664779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.664779] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.664779] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.665928] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.666093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.666352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.666505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.666610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.666829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.666939] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8183225b-bb0e-4ae3-928f-6f5fb2af07a1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.851248] env[66123]: INFO networking_nsxv3.common.synchronization [req-3dca8764-58f8-4276-bf19-c661ca8d24a2 req-e94275b1-f863-4dd5-a72d-f2c4c3a14c2f service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 1172.851433] env[66123]: INFO networking_nsxv3.common.synchronization [req-3dca8764-58f8-4276-bf19-c661ca8d24a2 req-e94275b1-f863-4dd5-a72d-f2c4c3a14c2f service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1172.851792] env[66123]: INFO networking_nsxv3.common.synchronization [req-3dca8764-58f8-4276-bf19-c661ca8d24a2 req-e94275b1-f863-4dd5-a72d-f2c4c3a14c2f service nova] Enqueued Resource ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 with Priority: HIGHEST for action port [ 1172.852148] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 1172.852246] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1172.852308] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 with Priority: HIGHEST for action port [ 1172.852591] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.852715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.852774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.852973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.853197] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.855710] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.855841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.856122] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e3c62b6-dc0f-4f48-9391-38b01db16793 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.856259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.856349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.856586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.856691] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3c62b6-dc0f-4f48-9391-38b01db16793',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.144598] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.168968] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.169171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.169348] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with status ACTIVE [ 1173.169540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.169667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.169750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.169991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.170121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.170330] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.170454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.170524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.170716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.170812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.171034] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.171154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.171237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.171403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.171497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.171598] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 is going to be updated. [ 1173.194773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.194947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.195071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.195290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.195453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.195660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.356587] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.356763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.359296] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e3c62b6-dc0f-4f48-9391-38b01db16793 with status ACTIVE [ 1173.359537] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.359629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.359713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.359897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.360066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.360236] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.360285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.360354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.360518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.360596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.360786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.360883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.360933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.361080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.361147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.361237] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 is going to be updated. [ 1173.386435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.386683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.386803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.387090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.387237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.387400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.550177] env[66123]: INFO networking_nsxv3.common.synchronization [req-e9eb573a-a4b7-4e60-92aa-d9436396ed74 req-ad6c6430-0b06-4bcf-a2f4-859fd3f9657e tempest-ServerRescueTestJSON-2105899017 tempest-ServerRescueTestJSON-2105899017-project-member] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1173.551297] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1173.551694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.551832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.551969] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.552206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.552389] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.552510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.552573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.552787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.552911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.552949] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.647832] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.816410] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1173.816651] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 deletion is rescheduled due to dependency. [ 1173.816770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.816932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.817166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.817352] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.817467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.817531] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.817786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.817871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.817969] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.902935] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.903125] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.903249] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.903575] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.903829] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.903983] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.904111] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.904319] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.904463] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.904667] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.904777] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.904880] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.905016] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.905113] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.905228] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.905354] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.923688] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.923918] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1173.923989] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.924195] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.924498] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-35803353-0f7d-46f0-9f7a-823ca8ca0986 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.924665] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.924781] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.925120] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.925260] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35803353-0f7d-46f0-9f7a-823ca8ca0986',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.056298] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.056480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.058473] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.058473] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d already deleted. [ 1174.058473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.150771] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.150771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.150771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.150999] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.151045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.151153] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be updated. [ 1174.178997] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.179218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.179218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.179380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.179529] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.189339] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: IN_PROGRESS for 2s [ 1174.322515] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.428736] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.428736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.428736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.428736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.428987] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.428987] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 35803353-0f7d-46f0-9f7a-823ca8ca0986 not found, creating... [ 1174.429174] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.429327] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.429627] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.429726] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.429808] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.430103] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.430262] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.430377] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.430580] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.430713] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.430849] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 35803353-0f7d-46f0-9f7a-823ca8ca0986 is going to be created. [ 1174.457028] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.457028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.457028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.457028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.457028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.457028] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.823970] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.193976] env[66123]: INFO networking_nsxv3.common.synchronization [req-e9eb573a-a4b7-4e60-92aa-d9436396ed74 req-7efbc6ce-0c61-446e-af56-e747bdf51e52 service nova] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_rules [ 1175.194198] env[66123]: INFO networking_nsxv3.common.synchronization [req-e9eb573a-a4b7-4e60-92aa-d9436396ed74 req-7efbc6ce-0c61-446e-af56-e747bdf51e52 service nova] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1175.194340] env[66123]: INFO networking_nsxv3.common.synchronization [req-e9eb573a-a4b7-4e60-92aa-d9436396ed74 req-7efbc6ce-0c61-446e-af56-e747bdf51e52 service nova] Enqueued Resource ID: 35803353-0f7d-46f0-9f7a-823ca8ca0986 with Priority: HIGHEST for action port [ 1175.194864] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_rules [ 1175.195010] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1175.195112] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35803353-0f7d-46f0-9f7a-823ca8ca0986 with Priority: HIGHEST for action port [ 1175.195385] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.195500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.195640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.195840] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.195924] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.199246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.199246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.199246] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.199246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-35803353-0f7d-46f0-9f7a-823ca8ca0986 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.199246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.199701] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35803353-0f7d-46f0-9f7a-823ca8ca0986',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.326316] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.326316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.326536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.326597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.326690] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.326792] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1175.367089] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.367373] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.367373] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.367514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.367758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.377885] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1175.700841] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.702861] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.702861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.702861] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35803353-0f7d-46f0-9f7a-823ca8ca0986 with status ACTIVE [ 1175.702861] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.702861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.704578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.704841] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.704943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.705215] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.705311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.705374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.705555] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.705640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.705831] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.705925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.705988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.706145] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.706219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.706305] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35803353-0f7d-46f0-9f7a-823ca8ca0986 is going to be updated. [ 1175.730535] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.730746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.730746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.730950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.731112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.731284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35803353-0f7d-46f0-9f7a-823ca8ca0986" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.199875] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: IN_PROGRESS for 4s [ 1176.203287] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.468797] env[66123]: INFO networking_nsxv3.common.synchronization [req-b58f3db7-c136-4d78-83b6-c647318b218c req-7510f7ec-1ef1-4588-904b-9562af88fe87 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1176.469532] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1176.469944] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.470098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.486947] env[66123]: INFO networking_nsxv3.common.synchronization [req-b58f3db7-c136-4d78-83b6-c647318b218c req-7510f7ec-1ef1-4588-904b-9562af88fe87 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1176.487137] env[66123]: INFO networking_nsxv3.common.synchronization [req-b58f3db7-c136-4d78-83b6-c647318b218c req-7510f7ec-1ef1-4588-904b-9562af88fe87 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1176.487284] env[66123]: INFO networking_nsxv3.common.synchronization [req-b58f3db7-c136-4d78-83b6-c647318b218c req-7510f7ec-1ef1-4588-904b-9562af88fe87 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with Priority: HIGHEST for action port [ 1176.488665] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_rules [ 1176.489430] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1176.489430] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with Priority: HIGHEST for action port [ 1176.489586] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.489750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.490803] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.490803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.491450] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.491450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.491450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.492116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.492116] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8183225b-bb0e-4ae3-928f-6f5fb2af07a1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.706207] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.706207] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.706443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.706519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.706618] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.706723] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be created. [ 1176.729667] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.729831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.729886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.730267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.730447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.740291] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: UNINITIALIZED for 2s [ 1176.994162] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 with status ACTIVE [ 1176.994400] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.994534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.994603] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.994826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.994916] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.995117] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.995215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.995278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.995438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.995520] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.995716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.995811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.995871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.996019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.996138] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.996183] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8183225b-bb0e-4ae3-928f-6f5fb2af07a1 is going to be updated. [ 1177.019431] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.019612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.019612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.019819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.019955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.020135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8183225b-bb0e-4ae3-928f-6f5fb2af07a1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.388657] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1177.389031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.389243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.389463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.389694] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.389817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.389881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.390079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.390155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.390251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.390366] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.892440] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.211065] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: SUCCESS [ 1178.211289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.211398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.211676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.211921] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.212109] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.212223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.212442] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.212568] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.212711] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.394684] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbec3ba3-84bb-4f89-a861-89e446288553: rpc.has_security_group_logging(os_id): False [ 1178.412745] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.413051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.413051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.413185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.413273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.413516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.413614] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.413680] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.413837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.413907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.413994] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1178.473872] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.474076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.474117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.474334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.474485] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.486633] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1178.715405] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.751329] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: SUCCESS [ 1178.751471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.751672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.752049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.752232] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.752340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.752412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.752651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.752954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.752954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.752954] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.217999] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.258104] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.258284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.258396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.258570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.258854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.259063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.259063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.259168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.259241] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.259332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.259476] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.259604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.259656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.259760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.259897] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.259983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.260056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.260190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.260266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.260345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.260434] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.721321] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.721636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.721636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.721945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.722141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.722320] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be updated. [ 1179.755507] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.755666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.755769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.756040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.756233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.763307] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d: rpc.has_security_group_logging(os_id): False [ 1179.767705] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: IN_PROGRESS for 2s [ 1179.784467] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.784661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.784706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.785100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.785355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.785703] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.785858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.785970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.786224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.786333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.786718] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.786998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.787088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.787255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.787354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.787581] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.787771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.787850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.788075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.788188] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.788283] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be created. [ 1179.854895] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.855121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.855121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.855335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.855546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.865979] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: IN_PROGRESS for 2s [ 1180.500350] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1180.500620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.646874] env[66123]: INFO networking_nsxv3.common.synchronization [req-8d5d3ffa-0b8c-4d66-ae97-354e31bfb9b5 req-5d2624ec-9b0b-4f05-8e96-99ad1e366921 tempest-AttachInterfacesUnderV243Test-323972633 tempest-AttachInterfacesUnderV243Test-323972633-project-member] Enqueued Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1180.647468] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca with Priority: HIGHEST for action security_group_members [ 1180.647830] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.647929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.781558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: SUCCESS [ 1181.781971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.781971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.782210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.782419] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.782544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.782611] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.782775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.782875] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.782974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.783093] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.784823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.786091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.786091] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.786091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.786091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.786091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.786091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.786091] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.878316] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: SUCCESS [ 1181.878544] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.288419] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.289387] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.289513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.289629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.290025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.290141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.290355] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.290524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.290599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.290796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.290921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.291040] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be updated. [ 1182.320788] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.320981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.321037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.321239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.321400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.330442] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: IN_PROGRESS for 2s [ 1182.793021] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca: rpc.has_security_group_logging(os_id): False [ 1182.813205] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.813367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.813457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.813674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.813766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.814039] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.814124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.814181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.814335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.814411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.814498] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be updated. [ 1182.891095] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.891338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.891408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.891623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.891767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.910241] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: IN_PROGRESS for 2s [ 1184.340609] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: SUCCESS [ 1184.341103] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca deletion is rescheduled due to dependency. [ 1184.341248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.341422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.341650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.341842] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.341965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.342043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.342206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.342285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.342413] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.847270] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.847436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.847436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.847660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.847790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.847994] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.848105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.848167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.848328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.848404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.848489] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be updated. [ 1184.874135] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.874282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.874350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.874565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.874710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.883771] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: IN_PROGRESS for 2s [ 1184.924411] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: SUCCESS [ 1184.924619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.924816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.925040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.925132] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.449988] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.450348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.450348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.450454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.450543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.450649] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be deleted. [ 1185.504850] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.505032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.505084] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.505344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.505452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.505577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.648363] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1185.648479] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1185.829133] env[66123]: INFO networking_nsxv3.common.synchronization [req-0be0415c-ac0c-4c94-ae3e-2615e30cba3c req-4fc4a5d0-2c2b-41a9-88cb-4cd460368676 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_members [ 1185.829678] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGHEST for action security_group_members [ 1185.830616] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.830616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.830616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.830822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.831059] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.831059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.831059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.831524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.831524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.831524] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.333555] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.333759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.333822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.334036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.334148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.334659] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.334659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.334659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.334853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.334853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.334853] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 is going to be updated. [ 1186.365029] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.365209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.365298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.365573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.365829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.374686] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2e724f-df49-49d1-bc73-5c8b240073d7 in Status: IN_PROGRESS for 2s [ 1186.894098] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca in Status: SUCCESS [ 1186.894394] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca deletion is rescheduled due to dependency. [ 1186.894394] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.894560] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.894774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.894956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.895090] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.895153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.895305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.895387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.895481] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d31c701-752c-4ea7-a57f-4c9f7cfd05ca',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.398635] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.398880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.398961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.399222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.399322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.399542] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.399648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.399712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.399868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.399948] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.400061] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d31c701-752c-4ea7-a57f-4c9f7cfd05ca is going to be deleted. [ 1187.428504] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.428686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.428728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.429195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.429195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.429367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d31c701-752c-4ea7-a57f-4c9f7cfd05ca" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.387829] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2e724f-df49-49d1-bc73-5c8b240073d7 in Status: SUCCESS [ 1188.388225] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 deletion is rescheduled due to dependency. [ 1188.388225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.569682] env[66123]: INFO networking_nsxv3.common.synchronization [None req-4f31e907-b67b-40ea-a040-231032eaf704 None None] Enqueued Resource ID: 1785d1c0-e564-46c8-9157-d72a1d2e5ef9 with Priority: HIGHEST for action port [ 1188.570361] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1785d1c0-e564-46c8-9157-d72a1d2e5ef9 with Priority: HIGHEST for action port [ 1188.570582] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-1785d1c0-e564-46c8-9157-d72a1d2e5ef9 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.570704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1785d1c0-e564-46c8-9157-d72a1d2e5ef9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.570786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1785d1c0-e564-46c8-9157-d72a1d2e5ef9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.571129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1785d1c0-e564-46c8-9157-d72a1d2e5ef9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.571241] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1785d1c0-e564-46c8-9157-d72a1d2e5ef9',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.074713] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1785d1c0-e564-46c8-9157-d72a1d2e5ef9 [ 1189.074713] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.074713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.074713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.074713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.074713] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.075988] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1785d1c0-e564-46c8-9157-d72a1d2e5ef9 already deleted. [ 1189.075988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1785d1c0-e564-46c8-9157-d72a1d2e5ef9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.775542] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d56a28ee-cf3c-4134-a4a4-3da685b940d8 None None] Enqueued Resource ID: 223bd571-b7dd-4de3-b31f-f537189f01c1 with Priority: HIGHEST for action port [ 1190.776237] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 223bd571-b7dd-4de3-b31f-f537189f01c1 with Priority: HIGHEST for action port [ 1190.776615] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-223bd571-b7dd-4de3-b31f-f537189f01c1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.776744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-223bd571-b7dd-4de3-b31f-f537189f01c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.776744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-223bd571-b7dd-4de3-b31f-f537189f01c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.776976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-223bd571-b7dd-4de3-b31f-f537189f01c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.777072] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('223bd571-b7dd-4de3-b31f-f537189f01c1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.932116] env[66123]: INFO networking_nsxv3.common.synchronization [None req-5c7e8fa4-543f-4f3d-980f-b322bda9e8d3 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_rules [ 1190.933064] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_rules [ 1190.933430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.933528] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.933598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.933862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.933949] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.043515] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d40f56f0-a336-4138-9c82-751bd0422bb1 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_rules [ 1191.043872] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_rules [ 1191.044490] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.044490] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.279933] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 223bd571-b7dd-4de3-b31f-f537189f01c1 [ 1191.279933] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.279933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.279933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.279933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.279933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.280377] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:223bd571-b7dd-4de3-b31f-f537189f01c1 already deleted. [ 1191.280377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-223bd571-b7dd-4de3-b31f-f537189f01c1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.460650] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.460807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.460878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.461123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.461239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.461317] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 already deleted. [ 1191.461404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.461577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.461722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.461817] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.993260] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.993746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.993746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.993746] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.993954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.993954] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 already deleted. [ 1191.994072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.044817] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1196.045188] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1196.141921] env[66123]: INFO networking_nsxv3.common.synchronization [req-6e3ba2c2-9e17-4411-9b99-613df5d4ae8a req-ce8c091e-8a95-4d9f-be2f-eb8cbf45bdb8 tempest-AttachInterfacesV270Test-648667717 tempest-AttachInterfacesV270Test-648667717-project-member] Enqueued Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_members [ 1196.142031] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_members [ 1196.142416] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.143347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.143347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.143347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.143347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.143347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.143347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.143347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.143347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.143797] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.444510] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-672 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.444717] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.444850] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.445268] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.445483] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.446211] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.446211] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.446211] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.446211] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.446433] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.446736] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.446736] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.446848] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.446848] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.446961] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.447118] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.470841] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.470971] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1196.471137] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.471317] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-672" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.471715] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-22446387-a92a-4dce-b90e-e8ba8297295b taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.471842] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.471954] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.472292] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.472434] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22446387-a92a-4dce-b90e-e8ba8297295b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.645785] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.646058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.646058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.646270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.646360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.646564] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.646660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.646721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.646869] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.646945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.647043] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864257a8-cef2-40c0-879c-3676112514c0 already deleted. [ 1196.647128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.977426] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.978116] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.978116] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.978373] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.978567] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.978752] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 22446387-a92a-4dce-b90e-e8ba8297295b not found, creating... [ 1196.979122] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.979294] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.979425] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.979659] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.979796] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.980099] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.980255] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.980369] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.980693] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.980825] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.980984] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 22446387-a92a-4dce-b90e-e8ba8297295b is going to be created. [ 1197.002977] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.003237] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.003364] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.003671] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.003931] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.004216] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.706511] env[66123]: INFO networking_nsxv3.common.synchronization [req-6e3ba2c2-9e17-4411-9b99-613df5d4ae8a req-a8dfa38a-bff2-446e-92b9-a01849b862ab service nova] Enqueued Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_rules [ 1197.706821] env[66123]: INFO networking_nsxv3.common.synchronization [req-6e3ba2c2-9e17-4411-9b99-613df5d4ae8a req-a8dfa38a-bff2-446e-92b9-a01849b862ab service nova] Enqueued Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_members [ 1197.706821] env[66123]: INFO networking_nsxv3.common.synchronization [req-6e3ba2c2-9e17-4411-9b99-613df5d4ae8a req-a8dfa38a-bff2-446e-92b9-a01849b862ab service nova] Enqueued Resource ID: 22446387-a92a-4dce-b90e-e8ba8297295b with Priority: HIGHEST for action port [ 1197.707379] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_rules [ 1197.707755] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_members [ 1197.707755] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22446387-a92a-4dce-b90e-e8ba8297295b with Priority: HIGHEST for action port [ 1197.708275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.708459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.708563] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.708907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.709056] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.710959] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.710959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.710959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.710959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.710959] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.710959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.710959] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.711254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.711254] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.711254] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.712615] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-22446387-a92a-4dce-b90e-e8ba8297295b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.712793] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.712851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.713195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.713892] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22446387-a92a-4dce-b90e-e8ba8297295b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.216281] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.217811] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.217811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.217811] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22446387-a92a-4dce-b90e-e8ba8297295b with status ACTIVE [ 1198.217811] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.217811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.218270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.218270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.218270] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.218364] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.218464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.218528] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.218676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.218750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.218963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.219107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.219172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.219317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.219392] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.219477] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22446387-a92a-4dce-b90e-e8ba8297295b is going to be updated. [ 1198.242330] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.242910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.242992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.243236] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.243378] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.243543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22446387-a92a-4dce-b90e-e8ba8297295b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.406525] env[66123]: INFO networking_nsxv3.common.synchronization [req-86ad9aa2-440a-43ad-8278-bc598fd9a481 req-ef9df64c-1748-4f52-aee7-c9a0b7b400c7 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_members [ 1198.407100] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_members [ 1198.407408] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.407524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.407594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.407839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.408046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.408480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.408547] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.408709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.408802] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.408915] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.712573] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.712893] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.712974] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.713278] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.713542] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.713695] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.713922] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.714023] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.714168] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.714368] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.714815] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.714943] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.715078] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.715196] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.715306] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.715441] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.721032] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.736204] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.736385] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.736519] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.736696] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-711" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.737128] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-dafd04c5-c39f-469e-8cbb-cc891173aac2 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.737338] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.737458] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.737821] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.737939] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafd04c5-c39f-469e-8cbb-cc891173aac2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.911450] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.911628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.911691] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.911926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.912037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.912249] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.912350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.912415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.912567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.912643] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.912756] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 already deleted. [ 1198.912913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.223473] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.223637] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.223709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.223933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.224036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.224141] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864257a8-cef2-40c0-879c-3676112514c0 is going to be created. [ 1199.242954] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.242954] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.243168] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.243383] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.243553] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.243701] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port dafd04c5-c39f-469e-8cbb-cc891173aac2 not found, creating... [ 1199.243976] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.244247] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.244370] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.244597] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.244736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.245040] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.245198] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.245312] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.245516] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.245647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.245798] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: dafd04c5-c39f-469e-8cbb-cc891173aac2 is going to be created. [ 1199.252763] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.253013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.253013] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.253213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.253389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.262928] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864257a8-cef2-40c0-879c-3676112514c0 in Status: UNINITIALIZED for 2s [ 1199.269340] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.269597] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.269723] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.270045] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.270299] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.270519] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.985214] env[66123]: INFO networking_nsxv3.common.synchronization [req-86ad9aa2-440a-43ad-8278-bc598fd9a481 req-e750d68e-b3cc-4901-b31b-d7b7fbc771dc service nova] Enqueued Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_rules [ 1199.985462] env[66123]: INFO networking_nsxv3.common.synchronization [req-86ad9aa2-440a-43ad-8278-bc598fd9a481 req-e750d68e-b3cc-4901-b31b-d7b7fbc771dc service nova] Enqueued Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_members [ 1199.985596] env[66123]: INFO networking_nsxv3.common.synchronization [req-86ad9aa2-440a-43ad-8278-bc598fd9a481 req-e750d68e-b3cc-4901-b31b-d7b7fbc771dc service nova] Enqueued Resource ID: dafd04c5-c39f-469e-8cbb-cc891173aac2 with Priority: HIGHEST for action port [ 1199.986378] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_rules [ 1199.986554] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_members [ 1199.986807] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafd04c5-c39f-469e-8cbb-cc891173aac2 with Priority: HIGHEST for action port [ 1199.987167] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.987347] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.987425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.987707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.987804] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.990343] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.990454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.990454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.990644] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.990805] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.990936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.991020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.991147] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.991209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.991303] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.992612] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-dafd04c5-c39f-469e-8cbb-cc891173aac2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.992612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.992612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.993117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.993117] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafd04c5-c39f-469e-8cbb-cc891173aac2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.490949] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.491168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.494444] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.495924] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dafd04c5-c39f-469e-8cbb-cc891173aac2 with status ACTIVE [ 1200.496546] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.496546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.496546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.496697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.496697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.497130] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.497130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.497130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.497276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.497276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.497514] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.497589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.497682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.497843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.497951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.497999] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dafd04c5-c39f-469e-8cbb-cc891173aac2 is going to be updated. [ 1200.521823] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.521970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.522184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.522291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.522441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.522625] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dafd04c5-c39f-469e-8cbb-cc891173aac2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.649197] env[66123]: INFO networking_nsxv3.common.synchronization [req-1583f7bc-97a0-4d9b-bc7c-0813c32d4c1b req-c40ff1ac-0fbe-4760-9716-84bd54b3e1ba tempest-ServerRescueTestJSON-2105899017 tempest-ServerRescueTestJSON-2105899017-project-member] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1200.649744] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1200.650065] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.650195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.650281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.650483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.650644] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.650755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.650818] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.650970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.651263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.651369] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.929479] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.929678] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.929801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.930097] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.930350] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.930505] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.930620] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.930827] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.930972] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.931436] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.931565] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.931674] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.931781] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.931894] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.932013] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.932283] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.951150] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.951536] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1200.951536] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.951661] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-651" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.951926] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-2ea71cea-9492-44c7-8fb0-aba10a207183 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.952112] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.952229] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.952563] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.952701] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ea71cea-9492-44c7-8fb0-aba10a207183',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.000385] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.154546] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.273572] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864257a8-cef2-40c0-879c-3676112514c0 in Status: SUCCESS [ 1201.273873] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.274072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.274381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.274581] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.274717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.274794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.274980] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.275074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.275161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.275253] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.455645] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.456019] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.456258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.456560] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.456715] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.456869] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 2ea71cea-9492-44c7-8fb0-aba10a207183 not found, creating... [ 1201.457151] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.457316] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.457433] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.457768] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.457823] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.458142] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.458299] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.458414] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.458663] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.458803] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.458950] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 2ea71cea-9492-44c7-8fb0-aba10a207183 is going to be created. [ 1201.489995] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.490367] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.490464] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.490812] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.491179] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.491426] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.502229] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.502393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.502429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.502632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.502758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.502822] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 is going to be created. [ 1201.533134] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.533425] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.533550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.533839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.534092] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.549231] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 in Status: UNINITIALIZED for 2s [ 1201.656725] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.777817] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.778052] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.778117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.778340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.778524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.778640] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.778712] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.778975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.778975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.779099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.779242] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.779336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.779408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.779554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.779773] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.779773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.779881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.779978] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.780063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.780143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.780250] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.159586] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.160081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.160081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.160081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.160243] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.160243] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be updated. [ 1202.171411] env[66123]: INFO networking_nsxv3.common.synchronization [req-1583f7bc-97a0-4d9b-bc7c-0813c32d4c1b req-34aa3c35-6f09-4e0c-a40b-792da1ae40a7 service nova] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_rules [ 1202.171630] env[66123]: INFO networking_nsxv3.common.synchronization [req-1583f7bc-97a0-4d9b-bc7c-0813c32d4c1b req-34aa3c35-6f09-4e0c-a40b-792da1ae40a7 service nova] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1202.171777] env[66123]: INFO networking_nsxv3.common.synchronization [req-1583f7bc-97a0-4d9b-bc7c-0813c32d4c1b req-34aa3c35-6f09-4e0c-a40b-792da1ae40a7 service nova] Enqueued Resource ID: 2ea71cea-9492-44c7-8fb0-aba10a207183 with Priority: HIGHEST for action port [ 1202.172380] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_rules [ 1202.172530] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1202.172665] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ea71cea-9492-44c7-8fb0-aba10a207183 with Priority: HIGHEST for action port [ 1202.173097] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.173249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.173315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.173592] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.173672] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.174807] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.174807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.174952] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ea71cea-9492-44c7-8fb0-aba10a207183 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.175055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.175094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.175385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.175385] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ea71cea-9492-44c7-8fb0-aba10a207183',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.192465] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.192666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.192756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.193012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.193185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.202558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: IN_PROGRESS for 2s [ 1202.282992] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 864257a8-cef2-40c0-879c-3676112514c0: rpc.has_security_group_logging(os_id): False [ 1202.303783] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.304017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.304017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.304212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.304305] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.304503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.304605] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.304669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.304828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.304907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.305121] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.305222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.305284] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.305447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.305525] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.305705] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.305868] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.306037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.306213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.306299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.306402] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864257a8-cef2-40c0-879c-3676112514c0 is going to be created. [ 1202.373404] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.373619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.373667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.373872] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.374124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.384798] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 864257a8-cef2-40c0-879c-3676112514c0 in Status: IN_PROGRESS for 2s [ 1202.677028] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.677167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.677378] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ea71cea-9492-44c7-8fb0-aba10a207183 with status ACTIVE [ 1202.677641] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.677641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.677892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.677892] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.678158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.678205] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.678322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.678368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.678639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.678639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.678792] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.678890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.678960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.679597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.679597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.679597] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ea71cea-9492-44c7-8fb0-aba10a207183 is going to be updated. [ 1202.700826] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.701060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.701184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.701441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.701630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.701845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ea71cea-9492-44c7-8fb0-aba10a207183" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.559728] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 in Status: SUCCESS [ 1203.559728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.559728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.560192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.560192] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.560192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.560324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.560412] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.560494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.560581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.560672] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.063084] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.214512] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: IN_PROGRESS for 4s [ 1204.397471] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 864257a8-cef2-40c0-879c-3676112514c0 in Status: SUCCESS [ 1204.397693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.567077] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 288466c7-44f1-41a4-b4b9-c2b2077a2db7: rpc.has_security_group_logging(os_id): False [ 1204.586289] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.586464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.586508] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.586708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.586795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.587046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.587146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.587203] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.587359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.587435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.587523] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 is going to be created. [ 1204.647379] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.647612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.647612] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.647791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.648039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.661437] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 in Status: IN_PROGRESS for 2s [ 1206.224500] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: SUCCESS [ 1206.225049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.225049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.225233] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.225305] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.225393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.225460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.225615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.225688] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.225786] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.674847] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 in Status: SUCCESS [ 1206.675098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.727713] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.174464] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.174643] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1207.230151] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.733140] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.733336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.733336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.733546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.733638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.733774] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be updated. [ 1207.766762] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.767160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.767160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.767337] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.767384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.779024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: IN_PROGRESS for 2s [ 1209.792017] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: SUCCESS [ 1209.792415] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.792658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.793027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.793435] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.793624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.793744] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.794015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.794169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.794328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.794485] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.297940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.298209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.298264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.298458] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.298629] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.298730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.298854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.298951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.299062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.299165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.299381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.299469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.299469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.299607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.299742] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.299885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.299885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.300055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.300131] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.300209] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.300294] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.445369] env[66123]: INFO networking_nsxv3.common.synchronization [req-6e00b358-b375-4a05-9496-a3e5248e7755 req-e8e08bc1-b58a-4c69-9585-6c0e36590e3e tempest-AttachInterfacesV270Test-648667717 tempest-AttachInterfacesV270Test-648667717-project-member] Enqueued Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_members [ 1210.446030] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGHEST for action security_group_members [ 1210.446296] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.446372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.446418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.446619] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.446778] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.446879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.446941] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.447099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.447760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.447760] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.802884] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d: rpc.has_security_group_logging(os_id): False [ 1210.821524] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.821756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.821838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.822167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.822321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.822597] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.822760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.822879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.823152] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.823263] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.823478] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.823582] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.823649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.823800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.823880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.824081] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.824181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.824244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.824387] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.824466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.824555] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be updated. [ 1210.886101] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.886339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.886407] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.886626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.886774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.900438] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: IN_PROGRESS for 2s [ 1210.953576] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.953576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.953576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.955511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.955511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.955511] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.955511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.955511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.955511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.955511] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.955511] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864257a8-cef2-40c0-879c-3676112514c0 is going to be updated. [ 1211.008680] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.008901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.008901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.009160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.009296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.021456] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864257a8-cef2-40c0-879c-3676112514c0 in Status: IN_PROGRESS for 2s [ 1212.518248] env[66123]: INFO networking_nsxv3.common.synchronization [req-fd865297-d2fc-4dd2-b37c-a36306d159e4 req-a2e8bf7f-7b52-4e31-bc90-6f405479694c tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1212.518248] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1212.518248] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.518248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.518248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.518248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.518947] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.518947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.518947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.518947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.518947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.519130] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.915982] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: SUCCESS [ 1212.916273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.023934] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.032923] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864257a8-cef2-40c0-879c-3676112514c0 in Status: SUCCESS [ 1213.033181] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864257a8-cef2-40c0-879c-3676112514c0 deletion is rescheduled due to dependency. [ 1213.033298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.527308] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.029218] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.029416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.029456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.029669] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.029757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.029857] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be updated. [ 1214.058493] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.058733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.058778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.059080] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.059269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.069672] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: IN_PROGRESS for 2s [ 1216.083638] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: SUCCESS [ 1216.083638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.518711] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.519047] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1222.520326] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1222.520768] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1226.190667] env[66123]: INFO networking_nsxv3.common.synchronization [req-5da1fd11-7f5a-439f-8ece-61223c0b0104 req-3d48f72c-172c-4de7-ab2a-0f12c5f8dfa6 tempest-ServerRescueTestJSON-2105899017 tempest-ServerRescueTestJSON-2105899017-project-member] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1226.190986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1226.191342] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.191464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.191533] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.191721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.191872] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.191972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.192045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.192195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.192280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.192372] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.694952] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.198309] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.701366] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.701623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.701623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.701997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.701997] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.702155] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be updated. [ 1227.733875] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.734158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.734158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.734311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.734832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.744198] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: IN_PROGRESS for 2s [ 1228.094995] env[66123]: INFO networking_nsxv3.common.synchronization [req-905a858d-000f-4b6e-9800-ea3d2856fe9b req-301aaccb-9027-41b2-9ed2-fb3e17fd18d9 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_members [ 1228.094995] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGHEST for action security_group_members [ 1228.094995] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.094995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.094995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.095343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.095520] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.095654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.095734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.095893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.095998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.096573] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.598827] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.599250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.599250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.599332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.599360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.599575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.599679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.599742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.599897] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.599975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.600076] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 is going to be updated. [ 1228.637936] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.638192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.638192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.638466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.638616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.649534] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 in Status: IN_PROGRESS for 2s [ 1229.755072] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: SUCCESS [ 1229.755461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.082794] env[66123]: INFO networking_nsxv3.common.synchronization [req-19ab1045-7a00-4325-91e8-28a1d8160a16 req-dd06c43a-0269-4139-8575-df6a7278f081 tempest-ServerActionsTestOtherA-940665122 tempest-ServerActionsTestOtherA-940665122-project-member] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1230.083583] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGHEST for action security_group_members [ 1230.083786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.083942] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.084019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.084178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.084333] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.084641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.084641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.084641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.084796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.084796] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.588236] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.588436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.588516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.588742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.588838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.589074] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.589177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.589248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.589534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.589534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.589665] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be updated. [ 1230.617121] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.617279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.617406] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.617586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.617736] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.627191] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: IN_PROGRESS for 2s [ 1230.660370] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 in Status: SUCCESS [ 1230.660370] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 deletion is rescheduled due to dependency. [ 1230.660504] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.862262] env[66123]: INFO networking_nsxv3.common.synchronization [req-3e94b96e-2aa9-4072-b37d-7dea4ffb4c46 req-d50cd8aa-49e0-4fb9-b297-2d35961305c8 tempest-ServersV294TestFqdnHostnames-1740533811 tempest-ServersV294TestFqdnHostnames-1740533811-project-member] Enqueued Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_members [ 1230.862904] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f8a69fc-5713-4493-96dc-78b604a9517d with Priority: HIGHEST for action security_group_members [ 1230.863227] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f8a69fc-5713-4493-96dc-78b604a9517d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.863348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.863411] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.863606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.863753] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.863849] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.863906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.864103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.864231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.864350] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f8a69fc-5713-4493-96dc-78b604a9517d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.369037] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.369037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.369037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.369360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.391628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.391912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.392060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.392136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.392353] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.392464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.392565] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f8a69fc-5713-4493-96dc-78b604a9517d is going to be updated. [ 1231.419666] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.419902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.419902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.420151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.420302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.430401] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f8a69fc-5713-4493-96dc-78b604a9517d in Status: IN_PROGRESS for 2s [ 1232.637757] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f in Status: SUCCESS [ 1232.638060] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f deletion is rescheduled due to dependency. [ 1232.638060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.880341] env[66123]: INFO networking_nsxv3.common.synchronization [req-610c45bf-72ec-4850-9c8f-bb1c95b3e582 req-bdee21e1-eca8-433a-a3e7-52ff664ba800 tempest-ServerRescueTestJSON-2105899017 tempest-ServerRescueTestJSON-2105899017-project-member] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1232.880967] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGHEST for action security_group_members [ 1232.881297] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.881420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.881488] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.881692] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.881847] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.881932] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.881998] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.882155] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.882245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.882379] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.384678] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.384847] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.384939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.385212] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.385313] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.385600] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.385665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.385665] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.385828] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.385920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.386016] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be updated. [ 1233.414169] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.414457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.414457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.414573] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.414770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.424385] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: IN_PROGRESS for 2s [ 1233.439095] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f8a69fc-5713-4493-96dc-78b604a9517d in Status: SUCCESS [ 1233.439384] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f8a69fc-5713-4493-96dc-78b604a9517d deletion is rescheduled due to dependency. [ 1233.439492] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f8a69fc-5713-4493-96dc-78b604a9517d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.434477] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d in Status: SUCCESS [ 1235.434820] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d deletion is rescheduled due to dependency. [ 1235.434919] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.881989] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.882377] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.196943] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d66cfd52-d66d-4008-a3d6-afe3a88ba11a None None] Enqueued Resource ID: 5932f299-0e0e-4920-a5c4-5fe3ade6f1da with Priority: HIGHEST for action port [ 1240.197536] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5932f299-0e0e-4920-a5c4-5fe3ade6f1da with Priority: HIGHEST for action port [ 1240.197847] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-5932f299-0e0e-4920-a5c4-5fe3ade6f1da taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.197967] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5932f299-0e0e-4920-a5c4-5fe3ade6f1da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.198056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5932f299-0e0e-4920-a5c4-5fe3ade6f1da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.198297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5932f299-0e0e-4920-a5c4-5fe3ade6f1da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.198430] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5932f299-0e0e-4920-a5c4-5fe3ade6f1da',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.701517] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5932f299-0e0e-4920-a5c4-5fe3ade6f1da [ 1240.702555] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.702719] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.702790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.703043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.703181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.703313] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5932f299-0e0e-4920-a5c4-5fe3ade6f1da already deleted. [ 1240.703413] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5932f299-0e0e-4920-a5c4-5fe3ade6f1da" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.297998] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ff9c6eba-09fb-46d6-9d5a-fb9a18be4f7a None None] Enqueued Resource ID: b33e8cb5-c88d-4c0f-914f-f37a8195eb9f with Priority: HIGHEST for action port [ 1242.298597] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b33e8cb5-c88d-4c0f-914f-f37a8195eb9f with Priority: HIGHEST for action port [ 1242.299173] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-b33e8cb5-c88d-4c0f-914f-f37a8195eb9f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.299303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b33e8cb5-c88d-4c0f-914f-f37a8195eb9f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.299375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b33e8cb5-c88d-4c0f-914f-f37a8195eb9f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.299642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b33e8cb5-c88d-4c0f-914f-f37a8195eb9f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.299751] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b33e8cb5-c88d-4c0f-914f-f37a8195eb9f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.802286] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b33e8cb5-c88d-4c0f-914f-f37a8195eb9f [ 1242.802575] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.802770] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.802850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.803167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.803285] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.803409] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b33e8cb5-c88d-4c0f-914f-f37a8195eb9f already deleted. [ 1242.803517] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b33e8cb5-c88d-4c0f-914f-f37a8195eb9f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.300041] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.300406] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1248.514260] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.514582] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.514582] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.514915] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.515267] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.515623] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.515623] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.515874] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.516056] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.516299] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.516430] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.516559] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.516700] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.516857] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.516992] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.517179] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.539201] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.539377] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1248.539593] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.539769] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-602" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.540095] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-0e3c62b6-dc0f-4f48-9391-38b01db16793 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.540265] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.540380] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.540638] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.540777] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3c62b6-dc0f-4f48-9391-38b01db16793',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.043661] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.043880] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.044038] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.044347] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.044623] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.044941] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.045123] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.045220] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.045442] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.045569] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.045879] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.046040] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.046158] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.046362] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.046564] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.046717] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 is going to be updated. [ 1249.069261] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.069470] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.069548] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.069822] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.070034] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.070262] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.184404] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1249.184660] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1249.797939] env[66123]: INFO networking_nsxv3.common.synchronization [req-4994e5d4-5438-4124-8dfd-11979a653aa3 req-e6467fc7-4a65-481b-a0a2-b6150d51d06b service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 1249.798207] env[66123]: INFO networking_nsxv3.common.synchronization [req-4994e5d4-5438-4124-8dfd-11979a653aa3 req-e6467fc7-4a65-481b-a0a2-b6150d51d06b service nova] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1249.798304] env[66123]: INFO networking_nsxv3.common.synchronization [req-4994e5d4-5438-4124-8dfd-11979a653aa3 req-e6467fc7-4a65-481b-a0a2-b6150d51d06b service nova] Enqueued Resource ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 with Priority: HIGHEST for action port [ 1249.798534] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_rules [ 1249.798673] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1249.798772] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 with Priority: HIGHEST for action port [ 1249.799393] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.799524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.799588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.799778] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.799858] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.800678] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.801300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.801300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.801300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.801300] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.801300] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.801558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.801558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.801558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.801646] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.802709] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e3c62b6-dc0f-4f48-9391-38b01db16793 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.802709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.802709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.802709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.802709] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3c62b6-dc0f-4f48-9391-38b01db16793',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.304372] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.304595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.304702] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.305656] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e3c62b6-dc0f-4f48-9391-38b01db16793 with status ACTIVE [ 1250.305855] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.305970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.306049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.306259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.306350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.306540] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.306636] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.307396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.307396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.307396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.307396] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.307396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.307396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.307686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.307686] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.307686] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e3c62b6-dc0f-4f48-9391-38b01db16793 is going to be updated. [ 1250.330893] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.331054] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.331115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.331351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.331484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.331626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e3c62b6-dc0f-4f48-9391-38b01db16793" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.809957] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.263834] env[66123]: INFO networking_nsxv3.common.synchronization [req-e21c0bba-deaf-44db-8cc9-10b8081549eb req-fab03550-7f06-42ed-a5c5-b72ad4f558cc tempest-InstanceActionsV221TestJSON-887746588 tempest-InstanceActionsV221TestJSON-887746588-project-member] Enqueued Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_members [ 1251.264389] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_members [ 1251.264690] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.264812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.264879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.265276] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.265443] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.265559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.265607] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.265761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.265848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.265953] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.312899] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.313078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.313150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.313368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.313463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.313564] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1251.346938] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.347197] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.347290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.347616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.347843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.357853] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1251.584953] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.585260] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-158" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.585426] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-158" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.585839] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-158" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.586664] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.586881] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.587051] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.587423] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.587697] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.587957] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.588130] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.588285] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.588435] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.588666] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.588840] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.589045] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.615501] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.615762] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.615923] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.616153] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-158" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.616547] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-8c3dcb57-e9fc-45de-b44b-1457080afcdc taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.616797] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.616921] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.617308] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.617471] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c3dcb57-e9fc-45de-b44b-1457080afcdc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.768406] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.768695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.768695] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.768910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.769014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.769219] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.769317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.769380] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.769542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.769635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.769697] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f0f783-1d0b-4736-896e-4347a6a7495a already deleted. [ 1251.769781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.120440] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.120903] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.120956] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.121315] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.121504] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.121749] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 8c3dcb57-e9fc-45de-b44b-1457080afcdc not found, creating... [ 1252.122109] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.122331] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.122501] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.122847] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.123113] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.123543] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.123742] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.123864] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.124122] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.124266] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.124407] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 8c3dcb57-e9fc-45de-b44b-1457080afcdc is going to be created. [ 1252.146958] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.147270] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.147425] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.147778] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.148064] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.148353] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.836195] env[66123]: INFO networking_nsxv3.common.synchronization [req-e21c0bba-deaf-44db-8cc9-10b8081549eb req-7b51b5e9-7941-4183-b366-51809d5881b1 service nova] Enqueued Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_rules [ 1252.836373] env[66123]: INFO networking_nsxv3.common.synchronization [req-e21c0bba-deaf-44db-8cc9-10b8081549eb req-7b51b5e9-7941-4183-b366-51809d5881b1 service nova] Enqueued Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_members [ 1252.836563] env[66123]: INFO networking_nsxv3.common.synchronization [req-e21c0bba-deaf-44db-8cc9-10b8081549eb req-7b51b5e9-7941-4183-b366-51809d5881b1 service nova] Enqueued Resource ID: 8c3dcb57-e9fc-45de-b44b-1457080afcdc with Priority: HIGHEST for action port [ 1252.837066] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_rules [ 1252.837214] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_members [ 1252.837316] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3dcb57-e9fc-45de-b44b-1457080afcdc with Priority: HIGHEST for action port [ 1252.837593] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.837725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.837833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.838051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.838149] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.839013] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.839130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.839195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.839393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.839491] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.839667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.839728] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.839881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.839985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.840222] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.842053] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c3dcb57-e9fc-45de-b44b-1457080afcdc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.842164] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.842436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.842436] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.842436] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c3dcb57-e9fc-45de-b44b-1457080afcdc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.344276] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.344609] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.344609] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.345469] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c3dcb57-e9fc-45de-b44b-1457080afcdc with status ACTIVE [ 1253.345678] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.345842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.345950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.346223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.346326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.346516] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.346641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.346704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.346874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.346941] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.347179] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.347309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.347374] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.347554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.347583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.347664] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c3dcb57-e9fc-45de-b44b-1457080afcdc is going to be updated. [ 1253.375046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.375046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.375046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.375046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.375356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.375356] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c3dcb57-e9fc-45de-b44b-1457080afcdc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.376908] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1253.377118] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.377262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.377460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.377639] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.377749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.377812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.377960] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.378056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.378141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.378231] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.850337] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.880272] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.353736] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.354289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.354289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.354570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.354760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.354942] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f0f783-1d0b-4736-896e-4347a6a7495a is going to be created. [ 1254.382734] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.383024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.383115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.383443] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.383583] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.385086] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbec3ba3-84bb-4f89-a861-89e446288553: rpc.has_security_group_logging(os_id): False [ 1254.397695] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f0f783-1d0b-4736-896e-4347a6a7495a in Status: UNINITIALIZED for 2s [ 1254.407626] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.407626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.407626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.408062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.408168] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.408457] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.408645] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.408765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.409016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.409129] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.409253] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1254.515822] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.516036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.516036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.516836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.516836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.535833] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1256.408337] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f0f783-1d0b-4736-896e-4347a6a7495a in Status: SUCCESS [ 1256.408757] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.408803] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.409045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.409248] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.409367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.409432] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.409622] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.409766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.409894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.410011] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.561129] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1256.561421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.912598] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.912844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.912844] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.913057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.913309] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.913480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.913480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.913642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.913730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.913817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.913959] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.914075] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.914134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.914426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.914536] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.914631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.914701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.914846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.914921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.915012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.915104] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.417453] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66f0f783-1d0b-4736-896e-4347a6a7495a: rpc.has_security_group_logging(os_id): False [ 1257.437034] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.437296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.437410] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.437718] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.437829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.438020] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.438146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.438210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.438393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.438503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.438686] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.438794] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.438858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.439034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.439126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.439397] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.439510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.439601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.440747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.440747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.440747] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66f0f783-1d0b-4736-896e-4347a6a7495a is going to be created. [ 1257.504329] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.504574] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.504652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.504993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.505295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.518893] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66f0f783-1d0b-4736-896e-4347a6a7495a in Status: IN_PROGRESS for 2s [ 1257.838423] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.838680] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1259.540695] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66f0f783-1d0b-4736-896e-4347a6a7495a in Status: SUCCESS [ 1259.541103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.839621] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.839938] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1263.989022] env[66123]: INFO networking_nsxv3.common.synchronization [req-fa227753-8765-48a5-b13b-3d03779f1628 req-94688bb3-cd34-42a6-b526-2f72ddec94af tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1263.990083] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1263.990539] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.990758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.990874] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.991200] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.991471] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.991658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.991766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.992058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.992229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.992378] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.450451] env[66123]: INFO networking_nsxv3.common.synchronization [req-a71c7f58-c197-4c1d-88f5-e3ea40732837 req-65240892-6dd7-4057-8bbf-8fbd2924ed06 tempest-AttachVolumeNegativeTest-377541296 tempest-AttachVolumeNegativeTest-377541296-project-member] Enqueued Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_members [ 1264.451513] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGHEST for action security_group_members [ 1264.451856] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.451993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.452117] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.452473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.453401] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.453401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.453401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.453401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.453401] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.453693] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.496083] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.496309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.496309] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.496575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.518737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.518952] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.519081] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.519140] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.519340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.519421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.519509] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1264.548836] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.549121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.549121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.549418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.549483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.559009] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1264.956062] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.956265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.956341] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.956767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.956767] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.956914] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.956971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.957016] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.957167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.957242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.957362] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 is going to be updated. [ 1264.987457] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.987457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.987457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.987672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.987720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.997210] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 in Status: IN_PROGRESS for 2s [ 1265.627311] env[66123]: INFO networking_nsxv3.common.synchronization [req-b0ec5e10-c3ef-44f9-b2ca-3c0d1fe23fec req-65dc2f6e-9cba-482f-95aa-7fecab2a5089 tempest-InstanceActionsV221TestJSON-887746588 tempest-InstanceActionsV221TestJSON-887746588-project-member] Enqueued Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_members [ 1265.627812] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGHEST for action security_group_members [ 1265.628134] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.628256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.628312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.628538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.628711] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.628805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.628871] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.629032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.629121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.629213] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.131101] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.131449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.131449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.131551] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.131642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.131836] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.131931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.132495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.132495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.132495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.132495] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f0f783-1d0b-4736-896e-4347a6a7495a is going to be updated. [ 1266.160584] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.160764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.160816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.161032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.161179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.169908] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f0f783-1d0b-4736-896e-4347a6a7495a in Status: IN_PROGRESS for 2s [ 1266.576190] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1266.576407] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a deletion is rescheduled due to dependency. [ 1266.576548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.009253] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 in Status: SUCCESS [ 1267.009526] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 deletion is rescheduled due to dependency. [ 1267.009837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.182832] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f0f783-1d0b-4736-896e-4347a6a7495a in Status: SUCCESS [ 1268.182832] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f0f783-1d0b-4736-896e-4347a6a7495a deletion is rescheduled due to dependency. [ 1268.182832] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.528464] env[66123]: INFO networking_nsxv3.common.synchronization [req-8bfc41e0-4a10-48f6-a8ef-872a531605ad req-6e22f22a-7bf3-4c63-811d-88a3884a092f tempest-ServerActionsTestOtherB-394653997 tempest-ServerActionsTestOtherB-394653997-project-member] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1268.529191] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGHEST for action security_group_members [ 1268.529599] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.529763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.529940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.530143] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.530377] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.530535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.530647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.530947] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.531060] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.531202] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.034094] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.034296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.034524] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.034604] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.034722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.034954] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.035082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.035161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.035329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.035424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.035512] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be updated. [ 1269.063258] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.063418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.063467] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.063750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.063927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.074096] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: IN_PROGRESS for 2s [ 1271.086364] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbec3ba3-84bb-4f89-a861-89e446288553 in Status: SUCCESS [ 1271.086751] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 deletion is rescheduled due to dependency. [ 1271.086751] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.530501] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1273.531222] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.142341] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.142705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.142705] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.142949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.142949] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.220817] env[66123]: INFO networking_nsxv3.common.synchronization [req-5de1719e-a55a-4edf-a7b7-c458876814ad req-1ffdd4a9-ab32-4111-893d-df1add81ea16 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1277.221368] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1277.221691] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.221811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.221881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.222082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.222237] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.222336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.222400] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.222578] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.222659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.222747] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.559325] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.559524] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.559634] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.559904] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.560169] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.560328] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.560445] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.560657] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.560801] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.561087] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1277.561184] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1277.561250] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1277.561378] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1277.561531] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1277.561642] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1277.561775] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1277.582946] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1277.583201] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1277.583350] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1277.583521] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.583833] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.584007] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.584132] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.584463] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.584598] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502bfc7b-1a52-42ea-adcf-576bf5bfaff9',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.645053] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.725159] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.725367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.725367] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.725562] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.725653] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.725847] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.725949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.726020] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.726172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.726249] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.726335] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1277.752642] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.752787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.752860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.753088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.753230] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.763695] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1278.087732] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.088026] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.088164] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.088461] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.088612] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.090258] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 502bfc7b-1a52-42ea-adcf-576bf5bfaff9 not found, creating... [ 1278.090258] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.090258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.090258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.090258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.090258] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.090884] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.090884] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.090884] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.090884] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.091157] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.091157] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 502bfc7b-1a52-42ea-adcf-576bf5bfaff9 is going to be created. [ 1278.117350] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.117904] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.117904] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.118032] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.118307] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.118509] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.147393] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.650083] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1278.650083] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1278.878759] env[66123]: INFO networking_nsxv3.common.synchronization [req-5de1719e-a55a-4edf-a7b7-c458876814ad req-ec120da6-457f-4cb5-8214-baa8d5ba3666 service nova] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 1278.878971] env[66123]: INFO networking_nsxv3.common.synchronization [req-5de1719e-a55a-4edf-a7b7-c458876814ad req-ec120da6-457f-4cb5-8214-baa8d5ba3666 service nova] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1278.879128] env[66123]: INFO networking_nsxv3.common.synchronization [req-5de1719e-a55a-4edf-a7b7-c458876814ad req-ec120da6-457f-4cb5-8214-baa8d5ba3666 service nova] Enqueued Resource ID: 502bfc7b-1a52-42ea-adcf-576bf5bfaff9 with Priority: HIGHEST for action port [ 1278.879653] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 1278.879779] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1278.879915] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 502bfc7b-1a52-42ea-adcf-576bf5bfaff9 with Priority: HIGHEST for action port [ 1278.880165] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.880336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.880389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.880548] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.880657] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.881714] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.881714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.881854] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.881854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.881970] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.882077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.882209] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502bfc7b-1a52-42ea-adcf-576bf5bfaff9',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.384589] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.384589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.384589] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 502bfc7b-1a52-42ea-adcf-576bf5bfaff9 with status ACTIVE [ 1279.384589] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.384589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.384589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.385153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.385153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.385153] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.385153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.385153] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.385331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.385393] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.385567] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.385827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.385827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.385912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.385912] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.386053] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 502bfc7b-1a52-42ea-adcf-576bf5bfaff9 is going to be updated. [ 1279.407663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.407763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.407763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.408067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.408286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.408286] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-502bfc7b-1a52-42ea-adcf-576bf5bfaff9" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.413568] env[66123]: INFO networking_nsxv3.common.synchronization [req-26789fea-e8cd-42ac-a236-46ad164e89fe req-bf8da7de-033c-48c8-ac26-3d7939cb5b6b tempest-ListServerFiltersTestJSON-1296099165 tempest-ListServerFiltersTestJSON-1296099165-project-member] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1279.414398] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1279.414517] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.414639] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.414706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.414943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.415302] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.415417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.415480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.415638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.415720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.415811] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.533109] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.533269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.533345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.533586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.552149] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1279.553311] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.554714] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1279.591302] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.591480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.591539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.591756] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.607108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.608037] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1279.608130] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.608171] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1279.652695] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.652845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.652929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.655024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.655024] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.655024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1279.726661] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.726806] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.726992] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.728891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.729293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.729632] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1279.772326] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.772566] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.772730] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.773210] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.773489] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.773647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.773762] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.773977] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.774139] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.774366] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1279.774477] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.774581] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.774683] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.774786] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1279.774890] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.775009] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.776558] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1279.776830] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a deletion is rescheduled due to dependency. [ 1279.776927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.778257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.778429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.778590] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.778715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.778787] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.778952] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.779049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.779184] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.802714] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.803141] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1279.803224] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.803483] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.803922] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-0af0cf41-c696-4ca5-8787-67b7dde1686a taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.804913] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.804913] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.804913] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.804913] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af0cf41-c696-4ca5-8787-67b7dde1686a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.814324] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.814475] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.814538] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.814735] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.815065] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.816329] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1279.816329] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'290fd936-57e7-4c7e-9104-b187d1d91b09', '66f0f783-1d0b-4736-896e-4347a6a7495a', 'df2e724f-df49-49d1-bc73-5c8b240073d7', '9172499c-e925-4db8-91df-db6b7bc0f5c2', 'a1b3e626-c03f-466a-b911-e8ab22cc99de', '6d99c9a7-0f38-4515-af08-ec4e5f2dc12d', 'e2f1f52d-14fb-4485-8ef3-6e0cc6291fce', 'bbec3ba3-84bb-4f89-a861-89e446288553', '16e086d7-22eb-4e20-9dda-bdb801fe920d', '92becbac-4b94-45df-b2f4-6067bd78d31b', '5e7447a7-e95d-4976-8f9e-99f0425169e1', 'a920e51b-9550-463b-b158-782df4ef60d2', '7190ac8a-97bd-4254-83bd-7f62dd7cd4b4', 'd4d8c960-3749-4fb8-86f5-1b9ff22fa8a8', 'de28cfe1-47d1-4e0d-9126-97eb3c037662', '69e73b71-1b94-4c07-a51a-893782ee1e09', '2c6dbcb4-05b5-47cd-91b4-bf12d7469a76', 'c98d0046-6918-47a2-9486-ba2fa2ba7743', '288466c7-44f1-41a4-b4b9-c2b2077a2db7', '46ae9dcf-d3ab-4655-9efc-c1a218c2dc56', '1932f921-51c6-4f18-8e91-2dc524b8516f', '3bc5413e-0daf-404c-8ccc-94e28756a174', 'e5028f4c-8816-49e2-a746-b352623465f8', '76bf622f-13b1-4d60-b853-8d93458e789a', 'bb8f4e60-4319-40b5-a8f3-20680c5bcb74', '672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455', 'a6b25007-70eb-4a46-96cf-27a55632b2b5', '86c8a328-51f3-46d6-a72c-f22aefa2fcf2', 'ee0f66d6-515b-47ee-bcf1-99417ad55a0a', 'ae4b87ee-cc63-4241-b970-23c1a58e9362', 'fc1efda8-467e-44a4-8d86-5f1d56a91f3c', '30a272b7-f056-46f6-bc0f-8e33fb6c2cd0', '864257a8-cef2-40c0-879c-3676112514c0', 'c33bec6e-2ebe-4c3c-a232-8a79edacefc8', '6be2818f-6bbe-47a1-a41d-086de5f4b5d0', 'd200e885-c7ad-4101-b6e0-e3026ae4d35f', '7fb7a681-0823-49de-9892-747a25a5f324', '7f8a69fc-5713-4493-96dc-78b604a9517d', '6a1c9505-3726-4617-ab67-cc7b3b1e107b', 'cc8e203a-a322-44a7-8e22-6a43e3c9abbd', '861f81b8-db22-4a30-a43a-194caa55e446', '7021f924-400e-4d63-ac79-b87e4a1fc7d7', 'f3b19fe3-562d-4163-b8e0-7d5f0c6475ed', '1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c'} {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.816329] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1279.833093] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.833288] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.833339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.833514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.833600] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.833712] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1279.833788] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.833868] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1279.907240] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.907416] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.907459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.907662] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.908774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.909114] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1279.909228] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.909300] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1279.909355] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1279.909407] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1279.909466] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGH for action security_group_rules [ 1279.909545] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGH for action security_group_rules [ 1279.909609] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGH for action security_group_rules [ 1279.909658] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGH for action security_group_rules [ 1279.909715] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGH for action security_group_rules [ 1279.909773] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGH for action security_group_rules [ 1279.909841] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGH for action security_group_rules [ 1279.909899] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGH for action security_group_rules [ 1279.909966] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGH for action security_group_rules [ 1279.910033] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGH for action security_group_rules [ 1279.910102] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGH for action security_group_rules [ 1279.910156] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGH for action security_group_rules [ 1279.910204] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGH for action security_group_rules [ 1279.910254] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGH for action security_group_rules [ 1279.910309] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGH for action security_group_rules [ 1279.910371] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGH for action security_group_rules [ 1279.910434] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGH for action security_group_rules [ 1279.910488] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGH for action security_group_rules [ 1279.910550] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGH for action security_group_rules [ 1279.910611] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGH for action security_group_rules [ 1279.910684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.918663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.918804] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.918889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.919059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.919137] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.919330] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.919450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.919515] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.919628] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.919697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.919763] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 already deleted. [ 1279.919846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.281816] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.307827] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.308040] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.308149] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.308439] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.308569] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.308699] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 0af0cf41-c696-4ca5-8787-67b7dde1686a not found, creating... [ 1280.309012] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.309186] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.309296] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.309501] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.309633] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.309980] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.310110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.310229] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.310429] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.310555] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.310687] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 0af0cf41-c696-4ca5-8787-67b7dde1686a is going to be created. [ 1280.333718] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.333927] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.334128] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.334385] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.334618] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.334970] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.784297] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.154665] env[66123]: INFO networking_nsxv3.common.synchronization [req-26789fea-e8cd-42ac-a236-46ad164e89fe req-3743acf7-d565-4342-aaba-8b9079c4c722 service nova] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_rules [ 1281.154665] env[66123]: INFO networking_nsxv3.common.synchronization [req-26789fea-e8cd-42ac-a236-46ad164e89fe req-3743acf7-d565-4342-aaba-8b9079c4c722 service nova] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1281.154870] env[66123]: INFO networking_nsxv3.common.synchronization [req-26789fea-e8cd-42ac-a236-46ad164e89fe req-3743acf7-d565-4342-aaba-8b9079c4c722 service nova] Enqueued Resource ID: 0af0cf41-c696-4ca5-8787-67b7dde1686a with Priority: HIGHEST for action port [ 1281.155553] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_rules [ 1281.155704] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1281.155808] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af0cf41-c696-4ca5-8787-67b7dde1686a with Priority: HIGHEST for action port [ 1281.155906] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 with Priority: HIGH for action security_group_rules [ 1281.156034] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e724f-df49-49d1-bc73-5c8b240073d7 with Priority: HIGH for action security_group_rules [ 1281.156107] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce with Priority: HIGH for action security_group_rules [ 1281.156201] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 with Priority: HIGH for action security_group_rules [ 1281.156296] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 with Priority: HIGH for action security_group_rules [ 1281.156381] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 with Priority: HIGH for action security_group_rules [ 1281.156471] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 with Priority: HIGH for action security_group_rules [ 1281.156557] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 with Priority: HIGH for action security_group_rules [ 1281.156638] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 with Priority: HIGH for action security_group_rules [ 1281.157175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 with Priority: HIGH for action security_group_rules [ 1281.157175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 with Priority: HIGH for action security_group_rules [ 1281.157175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920e51b-9550-463b-b158-782df4ef60d2 with Priority: HIGH for action security_group_rules [ 1281.157175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 with Priority: HIGH for action security_group_rules [ 1281.157175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92becbac-4b94-45df-b2f4-6067bd78d31b with Priority: HIGH for action security_group_rules [ 1281.157175] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d with Priority: HIGH for action security_group_rules [ 1281.157508] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d with Priority: HIGH for action security_group_rules [ 1281.157508] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbec3ba3-84bb-4f89-a861-89e446288553 with Priority: HIGH for action security_group_rules [ 1281.157508] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b3e626-c03f-466a-b911-e8ab22cc99de with Priority: HIGH for action security_group_rules [ 1281.157508] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f0f783-1d0b-4736-896e-4347a6a7495a with Priority: HIGH for action security_group_rules [ 1281.157690] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 with Priority: HIGH for action security_group_rules [ 1281.158021] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.158021] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.158146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.158396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.158504] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.160661] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.160661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.160661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.160661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.160661] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.160955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.160955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.160955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.161061] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.161107] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.161895] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-0af0cf41-c696-4ca5-8787-67b7dde1686a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.162031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.162085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.162232] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.162553] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af0cf41-c696-4ca5-8787-67b7dde1686a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.164595] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-290fd936-57e7-4c7e-9104-b187d1d91b09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.164595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.164595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.164595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.164595] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('290fd936-57e7-4c7e-9104-b187d1d91b09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.165340] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df2e724f-df49-49d1-bc73-5c8b240073d7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.165503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.165503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.165656] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.165730] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df2e724f-df49-49d1-bc73-5c8b240073d7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.166675] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.167449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.167449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.167449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.167449] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f1f52d-14fb-4485-8ef3-6e0cc6291fce',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.168287] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de28cfe1-47d1-4e0d-9126-97eb3c037662 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.168287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.168287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.168287] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.168605] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de28cfe1-47d1-4e0d-9126-97eb3c037662',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.169926] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.169926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.169926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.169926] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.169926] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46ae9dcf-d3ab-4655-9efc-c1a218c2dc56',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.170566] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.170661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.170727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.171549] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.171549] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('288466c7-44f1-41a4-b4b9-c2b2077a2db7',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.172295] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c98d0046-6918-47a2-9486-ba2fa2ba7743 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.172295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.172295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.172295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.172295] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c98d0046-6918-47a2-9486-ba2fa2ba7743',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.173890] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.173890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.173890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.173890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.173890] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6dbcb4-05b5-47cd-91b4-bf12d7469a76',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.173890] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.173890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.173890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.174459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.174459] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.176398] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e73b71-1b94-4c07-a51a-893782ee1e09 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.176398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.176398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.176398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.176398] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e73b71-1b94-4c07-a51a-893782ee1e09',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.176398] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.176398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.176398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.176398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.176398] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7190ac8a-97bd-4254-83bd-7f62dd7cd4b4',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.176894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a920e51b-9550-463b-b158-782df4ef60d2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.176894] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.177031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.177727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.177727] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a920e51b-9550-463b-b158-782df4ef60d2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.177912] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e7447a7-e95d-4976-8f9e-99f0425169e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.177994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.178088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.178213] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.178284] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e7447a7-e95d-4976-8f9e-99f0425169e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.179045] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92becbac-4b94-45df-b2f4-6067bd78d31b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.179683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.179683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.179683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.179683] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92becbac-4b94-45df-b2f4-6067bd78d31b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.180164] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e086d7-22eb-4e20-9dda-bdb801fe920d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.180904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.180904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.180904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.180904] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e086d7-22eb-4e20-9dda-bdb801fe920d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.181560] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.181766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.181902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.182066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.182139] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d99c9a7-0f38-4515-af08-ec4e5f2dc12d',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.182845] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbec3ba3-84bb-4f89-a861-89e446288553 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.182954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.183032] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.183179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.183250] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbec3ba3-84bb-4f89-a861-89e446288553',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.184142] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b3e626-c03f-466a-b911-e8ab22cc99de taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.184251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.184318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.184463] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.184536] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b3e626-c03f-466a-b911-e8ab22cc99de',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.185688] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66f0f783-1d0b-4736-896e-4347a6a7495a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.185798] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.185862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.186019] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.186094] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66f0f783-1d0b-4736-896e-4347a6a7495a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.186950] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9172499c-e925-4db8-91df-db6b7bc0f5c2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.187095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.187136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.187283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.187352] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9172499c-e925-4db8-91df-db6b7bc0f5c2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.190854] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.286973] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.287175] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.287223] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.287432] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.287516] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.287619] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1281.314418] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.314630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.314630] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.314805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.314923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.324665] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1281.663185] env[66123]: INFO networking_nsxv3.common.synchronization [req-07cdcb02-b291-4a0b-a71a-773a1482d496 req-70fbbb22-721a-4ee7-b087-520edea299ba tempest-ListServerFiltersTestJSON-1296099165 tempest-ListServerFiltersTestJSON-1296099165-project-member] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1281.663782] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1281.664170] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.664283] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.690705] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.690891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.699842] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0af0cf41-c696-4ca5-8787-67b7dde1686a with status ACTIVE [ 1281.700099] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.700229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.700298] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.700506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.700595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.700778] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.700896] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.700954] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.701141] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.701225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.701415] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.701514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.701575] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.701720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.701799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.701886] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0af0cf41-c696-4ca5-8787-67b7dde1686a is going to be updated. [ 1281.711689] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.735082] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.735299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.735355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.735663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.735747] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.735863] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be created. [ 1281.756252] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.756484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.756484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.756796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.762533] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.762727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.767279] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.767472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.791250] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.791629] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.792430] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.792584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.793983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.794107] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.794887] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.794985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.795711] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.795799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.796528] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.796621] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.797363] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.797469] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.798361] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.798456] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.799258] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.799668] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.799761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.800663] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.801079] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.801185] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.801805] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.802238] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.802333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.802950] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.803342] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.803445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.804464] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.804867] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.804987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.808090] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.808602] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.808706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.810921] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.811457] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.811589] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.812474] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.812909] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.813044] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.813136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.813382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.813663] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.813839] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0af0cf41-c696-4ca5-8787-67b7dde1686a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.814740] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.815305] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.815439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.816347] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.816902] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.817051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.817644] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1281.818076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.818201] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 290fd936-57e7-4c7e-9104-b187d1d91b09 is going to be deleted. [ 1281.819259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.819473] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.821196] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.821315] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.821379] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.821556] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.821698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.837159] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: UNINITIALIZED for 2s [ 1281.850194] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.850439] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f1f52d-14fb-4485-8ef3-6e0cc6291fce is going to be deleted. [ 1281.851438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.851660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.882340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.882426] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de28cfe1-47d1-4e0d-9126-97eb3c037662 is going to be deleted. [ 1281.883468] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.883727] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.923565] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.923714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.935110] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.935286] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c98d0046-6918-47a2-9486-ba2fa2ba7743 is going to be deleted. [ 1281.937074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.937074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.990090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.990349] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.994439] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.994725] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 288466c7-44f1-41a4-b4b9-c2b2077a2db7 is going to be deleted. [ 1281.995906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.996225] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.998491] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.998674] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.040166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.040363] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92becbac-4b94-45df-b2f4-6067bd78d31b is going to be deleted. [ 1282.042222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.042222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.045541] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.045766] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.045963] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.046256] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.046565] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.046843] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.047011] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.047290] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.047470] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.047802] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1282.047957] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1282.048133] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1282.048262] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1282.048392] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1282.048802] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1282.048802] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1282.097871] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1282.098128] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1282.098236] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1282.098416] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.098755] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-ababdcaf-b796-44de-8093-85b798f320bc taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.100301] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.100301] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.100301] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.100301] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ababdcaf-b796-44de-8093-85b798f320bc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.112579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.112674] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6dbcb4-05b5-47cd-91b4-bf12d7469a76 is going to be deleted. [ 1282.113702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.113968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.141722] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.141722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.144503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.144503] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e7447a7-e95d-4976-8f9e-99f0425169e1 is going to be deleted. [ 1282.145696] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.146010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.150824] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.151136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.207901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.208094] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66f0f783-1d0b-4736-896e-4347a6a7495a is going to be deleted. [ 1282.209099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.209336] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.232492] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.232706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.257722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.257870] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbec3ba3-84bb-4f89-a861-89e446288553 is going to be deleted. [ 1282.258792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.259089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.278011] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.278222] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.308281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.308461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.323536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.323735] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8 is going to be deleted. [ 1282.324996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.325339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.405173] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.405438] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.413523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.413808] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d99c9a7-0f38-4515-af08-ec4e5f2dc12d is going to be deleted. [ 1282.415342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.415805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.441896] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.442146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.464865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.465043] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e086d7-22eb-4e20-9dda-bdb801fe920d is going to be deleted. [ 1282.466322] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.466610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.525655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.525845] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e73b71-1b94-4c07-a51a-893782ee1e09 is going to be deleted. [ 1282.526776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.527023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.532720] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.532936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.558471] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.558554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.599296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.599296] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df2e724f-df49-49d1-bc73-5c8b240073d7 is going to be deleted. [ 1282.599861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.600150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.603432] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.603647] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.603774] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.604066] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.604223] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.604379] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port ababdcaf-b796-44de-8093-85b798f320bc not found, creating... [ 1282.604638] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.604799] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.604918] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.605166] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.605320] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.605765] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.606044] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.606252] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.606594] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.606793] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.607142] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: ababdcaf-b796-44de-8093-85b798f320bc is going to be created. [ 1282.615814] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.615975] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.633505] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.633629] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7190ac8a-97bd-4254-83bd-7f62dd7cd4b4 is going to be deleted. [ 1282.634588] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.634829] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.678552] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.678896] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.679041] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.679424] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.679677] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.680014] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.690375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.690624] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9172499c-e925-4db8-91df-db6b7bc0f5c2 is going to be deleted. [ 1282.691715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.691951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.703371] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.703610] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.749691] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.749973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.765606] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.765827] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46ae9dcf-d3ab-4655-9efc-c1a218c2dc56 is going to be deleted. [ 1282.766701] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.766971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.819129] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.819478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.825012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.825136] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b3e626-c03f-466a-b911-e8ab22cc99de is going to be deleted. [ 1282.826067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.826296] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.827949] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.828119] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.879909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.880220] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a920e51b-9550-463b-b158-782df4ef60d2 is going to be deleted. [ 1282.881219] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.881455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.881554] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.881672] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-290fd936-57e7-4c7e-9104-b187d1d91b09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.881834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.882023] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.882102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.882238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f1f52d-14fb-4485-8ef3-6e0cc6291fce" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.882768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.882939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.883066] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.883190] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de28cfe1-47d1-4e0d-9126-97eb3c037662" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.883324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.883503] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.883586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.883704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-288466c7-44f1-41a4-b4b9-c2b2077a2db7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.883834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.883982] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.884078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.884191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c98d0046-6918-47a2-9486-ba2fa2ba7743" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.884317] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.884459] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.884536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.884652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92becbac-4b94-45df-b2f4-6067bd78d31b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.884773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.884911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.884988] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.885115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6dbcb4-05b5-47cd-91b4-bf12d7469a76" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.885242] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.885382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.885457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.885567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e7447a7-e95d-4976-8f9e-99f0425169e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.885694] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.885834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.885910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.886041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66f0f783-1d0b-4736-896e-4347a6a7495a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.886199] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.886346] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.886422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.886552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbec3ba3-84bb-4f89-a861-89e446288553" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.886749] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.886933] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.887040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.887160] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d99c9a7-0f38-4515-af08-ec4e5f2dc12d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.887289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.887455] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.887535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.887649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4d8c960-3749-4fb8-86f5-1b9ff22fa8a8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.887773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.887917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.887996] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.888124] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e086d7-22eb-4e20-9dda-bdb801fe920d" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.888245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.888391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.888466] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.888577] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e73b71-1b94-4c07-a51a-893782ee1e09" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.888704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.888845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.889128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.889267] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df2e724f-df49-49d1-bc73-5c8b240073d7" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.889398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.889540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.889623] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.889721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7190ac8a-97bd-4254-83bd-7f62dd7cd4b4" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.889886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.890171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.890321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.890509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9172499c-e925-4db8-91df-db6b7bc0f5c2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.904827] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.904976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.905036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.905239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.905338] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.905501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46ae9dcf-d3ab-4655-9efc-c1a218c2dc56" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.970350] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.970615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.970615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.970761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.970855] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.970976] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b3e626-c03f-466a-b911-e8ab22cc99de" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.989437] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.990079] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.990307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.990429] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.990796] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.990930] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.991166] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a920e51b-9550-463b-b158-782df4ef60d2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.335746] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1283.336010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.336231] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.336460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.336651] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.336820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.336820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.337012] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.337100] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.337193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.337278] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.384553] env[66123]: INFO networking_nsxv3.common.synchronization [req-07cdcb02-b291-4a0b-a71a-773a1482d496 req-683f7b52-5bf0-4f48-b228-c24a1378ff6f service nova] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_rules [ 1283.384553] env[66123]: INFO networking_nsxv3.common.synchronization [req-07cdcb02-b291-4a0b-a71a-773a1482d496 req-683f7b52-5bf0-4f48-b228-c24a1378ff6f service nova] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1283.384757] env[66123]: INFO networking_nsxv3.common.synchronization [req-07cdcb02-b291-4a0b-a71a-773a1482d496 req-683f7b52-5bf0-4f48-b228-c24a1378ff6f service nova] Enqueued Resource ID: ababdcaf-b796-44de-8093-85b798f320bc with Priority: HIGHEST for action port [ 1283.385297] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_rules [ 1283.385436] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1283.385536] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ababdcaf-b796-44de-8093-85b798f320bc with Priority: HIGHEST for action port [ 1283.385836] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.385887] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.388593] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.388593] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.388963] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-ababdcaf-b796-44de-8093-85b798f320bc taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.389176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.389271] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.389584] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.389719] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ababdcaf-b796-44de-8093-85b798f320bc',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.839478] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.848983] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1283.849251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.849445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.849685] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.849896] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.850046] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.850130] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.850310] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.850404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.850512] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.853087] env[66123]: INFO networking_nsxv3.common.synchronization [req-a9779032-d942-4383-852c-edae95e6f5f7 req-8fb34286-a75a-4110-b97a-3192761b1861 tempest-ListServerFiltersTestJSON-1296099165 tempest-ListServerFiltersTestJSON-1296099165-project-member] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1283.853771] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1283.854130] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.854244] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.895247] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ababdcaf-b796-44de-8093-85b798f320bc with status ACTIVE [ 1283.895247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.895247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.895247] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.895247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.895247] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ababdcaf-b796-44de-8093-85b798f320bc is going to be updated. [ 1283.917530] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.917737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.917737] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.917943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.918098] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.918264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ababdcaf-b796-44de-8093-85b798f320bc" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.172145] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.172432] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.172570] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.172915] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.173248] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.173458] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.173581] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.173807] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.173951] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.174242] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1284.174369] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1284.174521] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1284.174620] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1284.174768] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1284.174904] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1284.175102] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1284.194208] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1284.194369] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1284.194503] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1284.194681] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-337" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.195021] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.195198] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.195313] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.195667] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.195804] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3fd595c-5e7a-455e-8a14-08df5fdd4cab',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.344994] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76bf622f-13b1-4d60-b853-8d93458e789a: rpc.has_security_group_logging(os_id): False [ 1284.354692] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.370940] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.371123] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.371224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.371409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.390928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.391246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.391362] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.391431] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.391627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.391709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.391801] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1284.457462] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.457658] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.457707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.457880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.458034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.470052] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1284.698641] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.698863] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.698967] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.699293] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.699440] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.699597] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port a3fd595c-5e7a-455e-8a14-08df5fdd4cab not found, creating... [ 1284.699859] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.700080] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.700202] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.700418] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.700550] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.700829] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.700981] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.701110] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.701313] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.701440] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.701577] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: a3fd595c-5e7a-455e-8a14-08df5fdd4cab is going to be created. [ 1284.721028] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.721263] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.721393] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.721679] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.721907] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.722150] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.857090] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.359691] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.359860] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.359931] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.360182] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.360280] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.360385] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1285.389233] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.389404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.389470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.389641] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.389876] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.399936] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1285.463996] env[66123]: INFO networking_nsxv3.common.synchronization [req-a9779032-d942-4383-852c-edae95e6f5f7 req-4dcaa738-dfbe-48f3-bbbe-ad97221869a6 service nova] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_rules [ 1285.464232] env[66123]: INFO networking_nsxv3.common.synchronization [req-a9779032-d942-4383-852c-edae95e6f5f7 req-4dcaa738-dfbe-48f3-bbbe-ad97221869a6 service nova] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1285.464450] env[66123]: INFO networking_nsxv3.common.synchronization [req-a9779032-d942-4383-852c-edae95e6f5f7 req-4dcaa738-dfbe-48f3-bbbe-ad97221869a6 service nova] Enqueued Resource ID: a3fd595c-5e7a-455e-8a14-08df5fdd4cab with Priority: HIGHEST for action port [ 1285.465077] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_rules [ 1285.465275] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1285.465526] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fd595c-5e7a-455e-8a14-08df5fdd4cab with Priority: HIGHEST for action port [ 1285.465760] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.465889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.466097] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.466206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.466408] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.466509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.466561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.466800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.466939] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3fd595c-5e7a-455e-8a14-08df5fdd4cab',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.972983] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3fd595c-5e7a-455e-8a14-08df5fdd4cab with status ACTIVE [ 1285.972983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.972983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.972983] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.972983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.972983] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3fd595c-5e7a-455e-8a14-08df5fdd4cab is going to be updated. [ 1285.995904] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.995904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.995904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.995904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.995904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.995904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3fd595c-5e7a-455e-8a14-08df5fdd4cab" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.482725] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1286.483014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.417636] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1287.418056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.418121] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.418472] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.418715] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.418881] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.418981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.419257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.419391] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.419513] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.419642] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.420808] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.421034] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.421263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.421375] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.421483] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.421659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.421755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.421860] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.924408] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.924408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.926460] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.428258] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.930757] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.931028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.931028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.931303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.931417] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.931535] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1288.963979] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.964220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.964220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.964430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.964579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.975292] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1290.466200] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.466571] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1290.988038] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1290.988229] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.988344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.988572] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.988763] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.988883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.988973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.989224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.989377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.989377] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.491383] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.994023] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.496267] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.496642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.496642] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.496733] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.496791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.496893] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1292.527956] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.528158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.528202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.528395] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.528546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.538085] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1294.549531] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1294.549826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.549922] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.550165] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.550357] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.550474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.550534] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.550683] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.550764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.550939] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.054045] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.467198] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.467348] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1295.556909] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.059375] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.059580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.059580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.059766] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.059856] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.059953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1296.088807] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.089045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.089045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.089295] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.089447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.098593] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1298.113516] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1298.113880] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.113917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.114148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.114350] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.114532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.114532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.114679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.114761] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.114843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.114995] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.115108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.115167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.115308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.115445] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.115537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.115597] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.115732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.115805] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.115888] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.115968] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.618417] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9dec317d-c042-4f12-bb65-cb7baa4f9905: rpc.has_security_group_logging(os_id): False [ 1298.639149] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.639372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.639372] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.639682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.639682] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.639873] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.640037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.640037] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.640192] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.640268] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.640473] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.640570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.640666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.640792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.640857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.641051] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.641173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.641227] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.641444] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.641528] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.641618] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be created. [ 1298.722152] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.722390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.722390] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.722620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.722799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.746795] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1300.468675] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.469119] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1300.760540] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1300.760789] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.760974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.761214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.761308] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.264093] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.264348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.264448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.264697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.264871] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.264972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.265050] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.265235] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.265398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.265510] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.265605] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.768263] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.768675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.768675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.768750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.768878] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.768981] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.769150] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.769303] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.769389] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.769478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.769625] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.769715] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.769774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.769909] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.770064] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.770174] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.770220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.770334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.770408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.770484] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.770569] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.272437] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9dec317d-c042-4f12-bb65-cb7baa4f9905: rpc.has_security_group_logging(os_id): False [ 1302.291108] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.291340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.291340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.291576] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.291667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.291884] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.291985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.292059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.292217] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.292294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.292503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.292595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.292655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.292816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.292891] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.293096] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.293218] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.293281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.293408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.293479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.293562] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1302.371292] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.371532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.371532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.371870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.372045] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.387674] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1304.402024] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1304.402428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.402428] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.402650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.402739] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.905145] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.905408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.905460] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.905708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.905889] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.905995] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.906074] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.906239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.906331] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.906420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.906512] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.409178] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.409598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.409598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.409679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.409818] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.409911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.409971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.410154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.410265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.410452] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.410591] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.410675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.410726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.410857] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.410992] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.411099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.411172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.411334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.411433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.411539] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.411652] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.469681] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.469845] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1305.913833] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9dec317d-c042-4f12-bb65-cb7baa4f9905: rpc.has_security_group_logging(os_id): False [ 1305.932859] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.933076] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.933126] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.933384] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.933501] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.933727] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.933848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.933923] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.934135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.934240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.934476] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.934585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.934660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.934837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.934921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.935151] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.935272] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.935339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.935509] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.935602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.935703] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1306.001633] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.001838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.001838] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.002069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.002220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.016115] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1306.618291] env[66123]: INFO networking_nsxv3.common.synchronization [req-795b5ad0-02b1-40bd-994a-083c708cbcbb req-43e05981-6040-4d9d-9b32-a64203c2604d tempest-ListServerFiltersTestJSON-1296099165 tempest-ListServerFiltersTestJSON-1296099165-project-member] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1306.618837] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1306.619211] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.619294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.619382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.619558] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.619706] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.619821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.619885] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.620040] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.620128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.620234] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.123475] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.625307] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.032882] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1308.033068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.128228] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.128479] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.128613] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.128925] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.129088] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.129278] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1308.161563] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.161739] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.163302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.163302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.163302] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.171573] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1310.182685] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1310.183051] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.619427] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.619830] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.194838] env[66123]: INFO networking_nsxv3.common.synchronization [req-2d62167c-e8ed-4248-aa4c-73b0958b5d40 req-c94067ad-095b-4ce1-9f80-78bd2238cbd6 tempest-ListServerFiltersTestJSON-1296099165 tempest-ListServerFiltersTestJSON-1296099165-project-member] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1313.195341] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1313.195663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.195752] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.195812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.196011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.196310] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.196427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.196489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.196654] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.196740] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.196834] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.698890] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.201406] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.704374] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.704587] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.704865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.705028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.705028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.705136] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1314.751634] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.751799] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.751865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.752177] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.752340] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.763733] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1316.775809] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1316.776151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.913075] env[66123]: INFO networking_nsxv3.common.synchronization [None req-9d054f08-f4e4-41f5-88ba-93769524d467 None None] Enqueued Resource ID: 8c327249-b148-4d51-a435-191be2a8de14 with Priority: HIGHEST for action port [ 1316.913878] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c327249-b148-4d51-a435-191be2a8de14 with Priority: HIGHEST for action port [ 1316.914518] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c327249-b148-4d51-a435-191be2a8de14 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.914518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c327249-b148-4d51-a435-191be2a8de14" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.914518] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c327249-b148-4d51-a435-191be2a8de14" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.914758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c327249-b148-4d51-a435-191be2a8de14" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.914846] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c327249-b148-4d51-a435-191be2a8de14',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.095826] env[66123]: INFO networking_nsxv3.common.synchronization [None req-ea4f91b9-61a5-44a2-985c-cc01b2a74284 tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_rules [ 1317.096690] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_rules [ 1317.096795] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.096928] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.096974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.097216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.097304] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.193795] env[66123]: INFO networking_nsxv3.common.synchronization [None req-685f9205-6c04-4584-aa40-b79a2cc39d65 tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_rules [ 1317.194358] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_rules [ 1317.194663] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.194758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.416752] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c327249-b148-4d51-a435-191be2a8de14 [ 1317.416986] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.417146] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.417216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.417445] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.417570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.417684] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c327249-b148-4d51-a435-191be2a8de14 already deleted. [ 1317.417775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c327249-b148-4d51-a435-191be2a8de14" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.616715] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.616865] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.616939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.617210] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.617333] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.617459] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b already deleted. [ 1317.617561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.617723] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.617904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.617990] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.138806] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.139128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.139128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.139914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.139914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.139914] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b already deleted. [ 1318.139914] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.018027] env[66123]: INFO networking_nsxv3.common.synchronization [None req-7ceba216-3461-4a2e-8afa-19657b168fea None None] Enqueued Resource ID: cf7494b4-1f4c-43ea-aced-868534839525 with Priority: HIGHEST for action port [ 1319.018027] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf7494b4-1f4c-43ea-aced-868534839525 with Priority: HIGHEST for action port [ 1319.018148] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf7494b4-1f4c-43ea-aced-868534839525 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.018289] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf7494b4-1f4c-43ea-aced-868534839525" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.018447] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf7494b4-1f4c-43ea-aced-868534839525" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.018580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf7494b4-1f4c-43ea-aced-868534839525" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.018724] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf7494b4-1f4c-43ea-aced-868534839525',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.522042] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf7494b4-1f4c-43ea-aced-868534839525 [ 1319.522042] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.522042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.522580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.522580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.522580] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.522678] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf7494b4-1f4c-43ea-aced-868534839525 already deleted. [ 1319.522726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf7494b4-1f4c-43ea-aced-868534839525" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.918404] env[66123]: INFO networking_nsxv3.common.synchronization [req-808113c2-1fff-4600-98b4-85dbc78a0e5b req-dff70008-501a-45fd-bbd4-6ee8dd4a5a03 tempest-ListServerFiltersTestJSON-1296099165 tempest-ListServerFiltersTestJSON-1296099165-project-member] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1319.918977] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGHEST for action security_group_members [ 1319.919347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.919478] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.919552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.919768] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.919947] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.920246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.920352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.920537] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.920632] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.920727] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.422531] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.422769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.422769] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.422994] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.423104] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.423307] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.423408] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.423470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.423624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.423700] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.423784] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be updated. [ 1320.452550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.452773] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.452833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.453116] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.453321] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.461873] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: IN_PROGRESS for 2s [ 1322.473059] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 in Status: SUCCESS [ 1322.473059] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 deletion is rescheduled due to dependency. [ 1322.473561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.671602] env[66123]: INFO networking_nsxv3.common.synchronization [req-b9c2eaea-952f-4b75-af77-26178693281b req-64e6cff2-6499-4347-a900-c14c8bcb2c02 tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_members [ 1323.672214] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_members [ 1323.672518] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.672635] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.672707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.672958] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.673124] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.673216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.673277] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.673433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.673521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.673611] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.960741] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.960933] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.961068] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.961417] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.961705] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.961881] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.962025] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.962380] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.962533] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.962745] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1323.962861] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1323.962970] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1323.963092] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1323.963202] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1323.963306] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1323.963436] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1323.984053] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1323.984053] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1323.984263] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1323.984370] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.984685] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-325cdf6c-748d-4fe6-8f17-a619a03d7027 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.984856] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.984976] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.985312] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.985454] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('325cdf6c-748d-4fe6-8f17-a619a03d7027',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.176545] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.176732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.176821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.177062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.177157] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.177384] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.177519] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.177602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.177765] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.177843] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.177943] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b already deleted. [ 1324.178026] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.487597] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.487845] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.487978] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.488367] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.488528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.488683] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port 325cdf6c-748d-4fe6-8f17-a619a03d7027 not found, creating... [ 1324.488943] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.489118] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.489286] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.489498] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.489645] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.489920] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.490088] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.490208] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.490426] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.490557] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.490707] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: 325cdf6c-748d-4fe6-8f17-a619a03d7027 is going to be created. [ 1324.511816] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.511816] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.511816] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.511816] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.511816] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.512132] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.231047] env[66123]: INFO networking_nsxv3.common.synchronization [req-b9c2eaea-952f-4b75-af77-26178693281b req-4894cc5b-3813-4587-ad05-6b6606e857e4 service nova] Enqueued Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_rules [ 1325.231817] env[66123]: INFO networking_nsxv3.common.synchronization [req-b9c2eaea-952f-4b75-af77-26178693281b req-4894cc5b-3813-4587-ad05-6b6606e857e4 service nova] Enqueued Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_members [ 1325.231817] env[66123]: INFO networking_nsxv3.common.synchronization [req-b9c2eaea-952f-4b75-af77-26178693281b req-4894cc5b-3813-4587-ad05-6b6606e857e4 service nova] Enqueued Resource ID: 325cdf6c-748d-4fe6-8f17-a619a03d7027 with Priority: HIGHEST for action port [ 1325.232358] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_rules [ 1325.232521] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_members [ 1325.232699] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 325cdf6c-748d-4fe6-8f17-a619a03d7027 with Priority: HIGHEST for action port [ 1325.233090] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.233297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.233414] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.233684] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.233811] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.235046] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.235202] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.235334] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.235657] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.236025] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.236025] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.236183] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.236328] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.236450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.236589] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.239664] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-325cdf6c-748d-4fe6-8f17-a619a03d7027 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.239837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.239905] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.240159] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.240269] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('325cdf6c-748d-4fe6-8f17-a619a03d7027',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.742691] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.742879] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.742985] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.743896] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 325cdf6c-748d-4fe6-8f17-a619a03d7027 with status ACTIVE [ 1325.744092] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.744205] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.744269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.744470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.744559] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.744728] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.744823] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.744889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.745033] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.745111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.745291] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.745385] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.745441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.745579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.745651] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.745734] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 325cdf6c-748d-4fe6-8f17-a619a03d7027 is going to be updated. [ 1325.769405] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.769598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.769598] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.769807] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.769957] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.770135] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-325cdf6c-748d-4fe6-8f17-a619a03d7027" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.249104] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.752057] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.752057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.752057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.752057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.752057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.752057] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b is going to be created. [ 1326.775417] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.775631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.775750] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.775965] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.776176] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.788386] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7af6783-0bd2-4e81-a95f-01929bc9267b in Status: UNINITIALIZED for 2s [ 1328.799773] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7af6783-0bd2-4e81-a95f-01929bc9267b in Status: SUCCESS [ 1328.800056] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.800169] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.800402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.800595] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.800720] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.800781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.800924] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.801014] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.801103] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.801192] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.303467] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.806555] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7af6783-0bd2-4e81-a95f-01929bc9267b: rpc.has_security_group_logging(os_id): False [ 1329.825483] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.825706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.825706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.825951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.826063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.826315] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.826421] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.826489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.826650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.826732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.826817] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b is going to be created. [ 1329.892436] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.892586] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.892631] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.892878] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.893101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.906699] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7af6783-0bd2-4e81-a95f-01929bc9267b in Status: IN_PROGRESS for 2s [ 1330.233571] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.233571] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1331.919799] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7af6783-0bd2-4e81-a95f-01929bc9267b in Status: SUCCESS [ 1331.920193] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.234791] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.234791] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.235604] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.236070] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.237587] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.238103] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.238974] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.239367] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.240144] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.240635] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.402194] env[66123]: INFO networking_nsxv3.common.synchronization [req-4d6f7af4-c148-46d8-b5ed-de48d8c27537 req-f99bd177-096a-4180-9a62-920d7efcf058 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1359.402734] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1359.403156] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.403540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.403540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.403540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.403831] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.403831] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.403963] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.404403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.404675] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.404675] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.908127] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.908127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.908127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.908127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.908127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.908127] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.908127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.908127] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.908601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.908601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.908601] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1359.936081] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.936306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.936355] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.936543] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.936693] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.944820] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1361.954931] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1361.955330] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a deletion is rescheduled due to dependency. [ 1361.955330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.403781] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.404191] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.332975] env[66123]: INFO networking_nsxv3.common.synchronization [req-10cf5a93-174c-4d4e-ad84-1bc3fd5bc9f4 req-635f9e40-f44b-4c6a-988f-785be73f4483 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1366.333410] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1366.333701] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.333817] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.333882] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.334082] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.334236] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.334326] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.334453] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.334532] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.334617] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.334712] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.607528] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.607736] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.607862] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.608147] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.608405] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.608561] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.608679] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.608894] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.609053] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.609303] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.609423] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.609524] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.609629] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.609737] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.609870] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.610017] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.630107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.630266] env[66123]: DEBUG dogpile.cache.region [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1366.630423] env[66123]: DEBUG dogpile.lock [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.630578] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "network-498" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.630999] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock port-d877ff1a-4503-4781-a0e7-77cd9db083db taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.631192] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.631312] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.631619] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.631755] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d877ff1a-4503-4781-a0e7-77cd9db083db',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.837195] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.837383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.837383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.837594] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.837706] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.837905] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.838055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.838055] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.838215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.838293] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.838379] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1366.862861] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.863062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.863062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.863265] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.863403] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.871677] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1367.135058] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.135058] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.135058] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.135494] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.135762] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.136028] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Segment Port d877ff1a-4503-4781-a0e7-77cd9db083db not found, creating... [ 1367.136456] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.136719] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.136923] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.137289] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.137518] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.137982] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.138253] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.138458] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.138777] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.139007] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.139249] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Resource: SegmentPort with ID: d877ff1a-4503-4781-a0e7-77cd9db083db is going to be created. [ 1367.158395] env[66123]: DEBUG networking_nsxv3.common.locking [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.158581] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.158687] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.158953] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.159233] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.159474] env[66123]: DEBUG oslo_concurrency.lockutils [None req-bee8c16b-e615-40c6-9dd0-74214400ab2d None None] Releasing lock "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.868124] env[66123]: INFO networking_nsxv3.common.synchronization [req-10cf5a93-174c-4d4e-ad84-1bc3fd5bc9f4 req-2c31deec-d74a-42fa-8b51-bb0a79565fab service nova] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 1367.868396] env[66123]: INFO networking_nsxv3.common.synchronization [req-10cf5a93-174c-4d4e-ad84-1bc3fd5bc9f4 req-2c31deec-d74a-42fa-8b51-bb0a79565fab service nova] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1367.868562] env[66123]: INFO networking_nsxv3.common.synchronization [req-10cf5a93-174c-4d4e-ad84-1bc3fd5bc9f4 req-2c31deec-d74a-42fa-8b51-bb0a79565fab service nova] Enqueued Resource ID: d877ff1a-4503-4781-a0e7-77cd9db083db with Priority: HIGHEST for action port [ 1367.869236] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_rules [ 1367.869394] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1367.869489] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d877ff1a-4503-4781-a0e7-77cd9db083db with Priority: HIGHEST for action port [ 1367.869843] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.869974] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.870091] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.870330] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.870418] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.871756] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.872041] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.872360] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-d877ff1a-4503-4781-a0e7-77cd9db083db taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.872540] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.872667] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.873043] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.873134] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d877ff1a-4503-4781-a0e7-77cd9db083db',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.372550] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.372781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.375242] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d877ff1a-4503-4781-a0e7-77cd9db083db with status ACTIVE [ 1368.375529] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.375704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.375822] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.376161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.376299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.376569] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.376717] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.376821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.377085] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.377215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.377500] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.377649] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.377755] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.377968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.378101] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.378232] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d877ff1a-4503-4781-a0e7-77cd9db083db is going to be updated. [ 1368.400304] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.400526] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.400638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.400955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.401186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.401441] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d877ff1a-4503-4781-a0e7-77cd9db083db" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.881580] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1368.881943] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a deletion is rescheduled due to dependency. [ 1368.881943] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.882027] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.882282] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.882479] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.882599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.882666] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.882826] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.882910] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.883015] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.385084] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.888082] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.391301] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.391661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.391661] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.391783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.391783] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.391953] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1370.423541] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.423790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.423790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.423953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.424180] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.434036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1372.444927] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1372.445359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.445359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.445599] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.445793] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.445917] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.445987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.446161] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.446245] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.446332] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.446421] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.870812] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.870812] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1372.949097] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.451695] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76bf622f-13b1-4d60-b853-8d93458e789a: rpc.has_security_group_logging(os_id): False [ 1373.475542] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.475760] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.475830] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.476089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.476186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.476442] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.476546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.476608] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.476764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.476842] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.476929] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1373.549817] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.550078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.550078] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.550291] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.550433] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.571573] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1375.592478] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1375.592937] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.871871] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.872338] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.873081] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.873397] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.874622] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.875060] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.875462] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.875817] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.877134] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.877554] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.877864] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.878333] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.879490] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.879914] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.880563] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.880944] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.881428] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.881734] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.882867] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.883234] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.884047] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.884047] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.050290] env[66123]: INFO networking_nsxv3.common.synchronization [req-1b5d9190-9324-4594-ac9b-64f4f5c83650 req-715dc31a-cb13-47e0-92b0-3669d7118ee0 tempest-ServerActionsTestJSON-1644256629 tempest-ServerActionsTestJSON-1644256629-project-member] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1430.051801] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGHEST for action security_group_members [ 1430.052422] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.052422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.052422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.052745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.052911] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.053689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.053689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.053689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.053689] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.053869] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.557523] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.557523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.557523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.557523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.557523] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.557726] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.557726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.557726] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.558247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.558247] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.558247] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be updated. [ 1430.616237] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.616237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.616237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.616237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.616237] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.627624] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: IN_PROGRESS for 2s [ 1432.639023] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76bf622f-13b1-4d60-b853-8d93458e789a in Status: SUCCESS [ 1432.639422] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a deletion is rescheduled due to dependency. [ 1432.639422] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.053487] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.053487] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.269582] env[66123]: INFO networking_nsxv3.common.synchronization [None req-da6832fb-baa3-4d33-ab56-8db4642aca94 None None] Enqueued Resource ID: 486bbe70-e9fa-4e0f-9766-df8bce42b2e1 with Priority: HIGHEST for action port [ 1438.270245] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 486bbe70-e9fa-4e0f-9766-df8bce42b2e1 with Priority: HIGHEST for action port [ 1438.270716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-486bbe70-e9fa-4e0f-9766-df8bce42b2e1 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.270889] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-486bbe70-e9fa-4e0f-9766-df8bce42b2e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.270993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-486bbe70-e9fa-4e0f-9766-df8bce42b2e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.271699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-486bbe70-e9fa-4e0f-9766-df8bce42b2e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.271699] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('486bbe70-e9fa-4e0f-9766-df8bce42b2e1',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.774107] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 486bbe70-e9fa-4e0f-9766-df8bce42b2e1 [ 1438.774398] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.774561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.774647] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.774861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.774955] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.775062] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:486bbe70-e9fa-4e0f-9766-df8bce42b2e1 already deleted. [ 1438.775148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-486bbe70-e9fa-4e0f-9766-df8bce42b2e1" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.270999] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.271418] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.272436] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.272752] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.273887] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.273887] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.274925] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.275346] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.276135] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.276621] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.277156] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.277473] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.553385] env[66123]: INFO networking_nsxv3.common.synchronization [req-ebbc2c4c-b3cc-485c-84c1-b450caa56cd7 req-74b6142d-8741-4b72-aca0-c49462bc6ff3 tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_members [ 1472.553623] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGHEST for action security_group_members [ 1472.553926] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.554068] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.554139] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.554350] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.554508] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.554624] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.554702] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.554902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.555010] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.555115] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.057147] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.057354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.057354] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.057585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.057678] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.057876] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.057977] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.058057] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.058215] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.058290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.058375] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b is going to be updated. [ 1473.090560] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.090791] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.090837] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.091142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.091319] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.100054] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7af6783-0bd2-4e81-a95f-01929bc9267b in Status: IN_PROGRESS for 2s [ 1475.112120] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7af6783-0bd2-4e81-a95f-01929bc9267b in Status: SUCCESS [ 1475.112546] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b deletion is rescheduled due to dependency. [ 1475.112546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.365954] env[66123]: INFO networking_nsxv3.common.synchronization [None req-18049f49-37e0-4608-9128-e04a76ac37f3 tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_rules [ 1477.366529] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_rules [ 1477.366846] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.366972] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.367049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.367281] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.367427] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.445825] env[66123]: INFO networking_nsxv3.common.synchronization [None req-d8642c29-313a-4f6e-90f3-ef7ba61749ab tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_rules [ 1477.446271] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_rules [ 1477.446574] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.446679] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.889310] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.889418] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.889480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.889699] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.889792] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.889887] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2042273-fe02-491f-a396-b4a0546c4166 already deleted. [ 1477.889973] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.890142] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.890299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.890382] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.411918] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.412329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.412329] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.412404] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.412464] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.412596] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2042273-fe02-491f-a396-b4a0546c4166 already deleted. [ 1478.412660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.447695] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.447996] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.767547] env[66123]: INFO networking_nsxv3.common.synchronization [req-7309defb-6d8c-4de3-9b17-e12dddc3bb75 req-1a91a808-8e1a-4733-a807-96cba949b224 tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_members [ 1482.767806] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_members [ 1482.768125] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.768251] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.768325] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.768564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.768714] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.768819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.768877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.769031] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.769112] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.769183] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.050252] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.050528] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.050719] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.051096] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.051429] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.051650] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.051825] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.052147] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.052356] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.052638] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1483.052815] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] NeedRegenerationException {{(pid=66123) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1483.052979] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] no value, waiting for create lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1483.053134] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] value creation lock acquired {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1483.053311] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] No value present for key: 'zone-id' {{(pid=66123) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1483.053439] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Calling creation function for not-yet-present value {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1483.053654] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1483.077117] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1483.077413] env[66123]: DEBUG dogpile.cache.region [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66123) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1483.077596] env[66123]: DEBUG dogpile.lock [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Released creation lock {{(pid=66123) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1483.077866] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "network-880" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.078317] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280 taken with stack trace [, , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.078587] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.078771] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.079223] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.079414] env[66123]: DEBUG networking_nsxv3.api.rpc [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b8a2247-0c66-47e3-acc4-f7ba6c75e280',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.271889] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.272170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.272170] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.272457] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.272570] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.272786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.272886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.273058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.273172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.273216] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.273326] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2042273-fe02-491f-a396-b4a0546c4166 already deleted. [ 1483.273427] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.581578] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.581909] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.581958] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.582536] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.582536] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.582664] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Segment Port 2b8a2247-0c66-47e3-acc4-f7ba6c75e280 not found, creating... [ 1483.582885] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.583060] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.583167] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.583477] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.583549] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.583839] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.583995] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.584131] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.584337] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.584477] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.584608] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Resource: SegmentPort with ID: 2b8a2247-0c66-47e3-acc4-f7ba6c75e280 is going to be created. [ 1483.605664] env[66123]: DEBUG networking_nsxv3.common.locking [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.605873] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.605977] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.606302] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.606536] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.606761] env[66123]: DEBUG oslo_concurrency.lockutils [None req-68abc4b2-e09a-471c-996e-73201c8665f5 None None] Releasing lock "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.298414] env[66123]: INFO networking_nsxv3.common.synchronization [req-7309defb-6d8c-4de3-9b17-e12dddc3bb75 req-7f96c715-9418-44ea-9e91-5bce3a4ddb3f service nova] Enqueued Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_rules [ 1484.298657] env[66123]: INFO networking_nsxv3.common.synchronization [req-7309defb-6d8c-4de3-9b17-e12dddc3bb75 req-7f96c715-9418-44ea-9e91-5bce3a4ddb3f service nova] Enqueued Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_members [ 1484.298726] env[66123]: INFO networking_nsxv3.common.synchronization [req-7309defb-6d8c-4de3-9b17-e12dddc3bb75 req-7f96c715-9418-44ea-9e91-5bce3a4ddb3f service nova] Enqueued Resource ID: 2b8a2247-0c66-47e3-acc4-f7ba6c75e280 with Priority: HIGHEST for action port [ 1484.299260] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_rules [ 1484.299396] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_members [ 1484.299494] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8a2247-0c66-47e3-acc4-f7ba6c75e280 with Priority: HIGHEST for action port [ 1484.299764] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.299890] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.299944] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.300206] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.300243] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.301056] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.301171] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.301239] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.301396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.301597] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.301698] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.301759] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.301906] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.302017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.302137] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.303894] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.304017] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.304071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.304220] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.304293] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b8a2247-0c66-47e3-acc4-f7ba6c75e280',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.806393] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.807422] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.807541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.807678] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b8a2247-0c66-47e3-acc4-f7ba6c75e280 with status ACTIVE [ 1484.807836] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.807936] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.808011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.808902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.808902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.808902] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.808902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.808902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.808902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.808902] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.809306] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.809306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.809306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.809306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.809306] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.809486] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b8a2247-0c66-47e3-acc4-f7ba6c75e280 is going to be updated. [ 1484.831047] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.831047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.831047] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.831344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.831344] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.831500] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b8a2247-0c66-47e3-acc4-f7ba6c75e280" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.311468] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.814117] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.814542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.814542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.814542] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.814648] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.814737] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2042273-fe02-491f-a396-b4a0546c4166 is going to be created. [ 1485.841782] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.842039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.842039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.842224] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.842396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.853078] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: UNINITIALIZED for 2s [ 1487.863974] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: SUCCESS [ 1487.864358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.864358] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.864536] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.864735] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.864854] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.864921] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.865105] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.865191] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.865279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.865386] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.368527] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.870870] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2042273-fe02-491f-a396-b4a0546c4166: rpc.has_security_group_logging(os_id): False [ 1488.888904] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.889134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.889134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.889335] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.889426] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.889669] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.889771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.889835] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.889987] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.890077] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.890167] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2042273-fe02-491f-a396-b4a0546c4166 is going to be created. [ 1488.949564] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.949821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.949821] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.949991] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.950195] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.962560] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: IN_PROGRESS for 2s [ 1489.185442] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1489.185570] env[66123]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e3bbf372-e95a-4798-a6f7-4aef8d5d3243 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1489.300412] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.300619] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1490.976173] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: SUCCESS [ 1490.976565] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.302206] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.302650] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.303934] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.304375] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1504.305231] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.305617] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.306632] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.307388] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.308398] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.310873] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.142381] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.142834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.142834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.143339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.143339] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.645490] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.147146] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.650019] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1518.650233] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1519.312127] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.312491] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1519.440998] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.441255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.441255] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.441497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.595047] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1519.595893] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.597223] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1519.635599] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.635834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.635834] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.636049] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.648011] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.648897] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1519.648979] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1519.649085] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1519.684288] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.684552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.684552] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.684725] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.685382] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.685536] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1519.775205] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.775451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.775451] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.775626] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.775939] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.776233] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1519.861429] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.861627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.861627] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.861781] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.862096] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.862380] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:27. [ 1519.862460] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9dec317d-c042-4f12-bb65-cb7baa4f9905', 'f2042273-fe02-491f-a396-b4a0546c4166', '1932f921-51c6-4f18-8e91-2dc524b8516f', '3bc5413e-0daf-404c-8ccc-94e28756a174', 'e5028f4c-8816-49e2-a746-b352623465f8', '76bf622f-13b1-4d60-b853-8d93458e789a', 'bb8f4e60-4319-40b5-a8f3-20680c5bcb74', '672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455', 'a6b25007-70eb-4a46-96cf-27a55632b2b5', '86c8a328-51f3-46d6-a72c-f22aefa2fcf2', 'ee0f66d6-515b-47ee-bcf1-99417ad55a0a', 'ae4b87ee-cc63-4241-b970-23c1a58e9362', 'fc1efda8-467e-44a4-8d86-5f1d56a91f3c', '30a272b7-f056-46f6-bc0f-8e33fb6c2cd0', '864257a8-cef2-40c0-879c-3676112514c0', 'f7af6783-0bd2-4e81-a95f-01929bc9267b', 'c33bec6e-2ebe-4c3c-a232-8a79edacefc8', '6be2818f-6bbe-47a1-a41d-086de5f4b5d0', 'd200e885-c7ad-4101-b6e0-e3026ae4d35f', '7fb7a681-0823-49de-9892-747a25a5f324', '7f8a69fc-5713-4493-96dc-78b604a9517d', '6a1c9505-3726-4617-ab67-cc7b3b1e107b', 'cc8e203a-a322-44a7-8e22-6a43e3c9abbd', '861f81b8-db22-4a30-a43a-194caa55e446', '7021f924-400e-4d63-ac79-b87e4a1fc7d7', 'f3b19fe3-562d-4163-b8e0-7d5f0c6475ed', '1bcfc5ad-b99f-4f61-b7e0-6b7422b3d66c'} {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1519.862546] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1519.967825] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.968067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.968067] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.968299] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.968359] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.968468] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1519.968554] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1519.968613] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1520.061045] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.061290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.061290] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.061497] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.063022] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.063108] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1520.063188] env[66123]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66123) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1520.063388] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1520.064986] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1520.064986] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/27 resources of Type:Security Group Rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGH for action security_group_rules [ 1520.064986] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.312925] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.313387] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1524.313387] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 with Priority: HIGH for action security_group_rules [ 1524.313387] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1932f921-51c6-4f18-8e91-2dc524b8516f with Priority: HIGH for action security_group_rules [ 1524.313387] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 with Priority: HIGH for action security_group_rules [ 1524.313666] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864257a8-cef2-40c0-879c-3676112514c0 with Priority: HIGH for action security_group_rules [ 1524.313666] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7a681-0823-49de-9892-747a25a5f324 with Priority: HIGH for action security_group_rules [ 1524.313666] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f with Priority: HIGH for action security_group_rules [ 1524.313815] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 with Priority: HIGH for action security_group_rules [ 1524.313849] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 with Priority: HIGH for action security_group_rules [ 1524.313939] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 with Priority: HIGH for action security_group_rules [ 1524.314050] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7af6783-0bd2-4e81-a95f-01929bc9267b with Priority: HIGH for action security_group_rules [ 1524.314130] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c with Priority: HIGH for action security_group_rules [ 1524.314211] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 with Priority: HIGH for action security_group_rules [ 1524.314296] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a with Priority: HIGH for action security_group_rules [ 1524.314381] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 with Priority: HIGH for action security_group_rules [ 1524.314468] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 with Priority: HIGH for action security_group_rules [ 1524.314562] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf622f-13b1-4d60-b853-8d93458e789a with Priority: HIGH for action security_group_rules [ 1524.314651] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 with Priority: HIGH for action security_group_rules [ 1524.314739] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5028f4c-8816-49e2-a746-b352623465f8 with Priority: HIGH for action security_group_rules [ 1524.314826] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGH for action security_group_rules [ 1524.314913] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 with Priority: HIGH for action security_group_rules [ 1524.315281] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dec317d-c042-4f12-bb65-cb7baa4f9905 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.315409] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.315474] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.315697] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.315777] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dec317d-c042-4f12-bb65-cb7baa4f9905',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.316821] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1932f921-51c6-4f18-8e91-2dc524b8516f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.316938] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.317008] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.317184] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.317258] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1932f921-51c6-4f18-8e91-2dc524b8516f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.318132] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.318266] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.318308] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.318448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.318515] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb8f4e60-4319-40b5-a8f3-20680c5bcb74',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.319186] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864257a8-cef2-40c0-879c-3676112514c0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.319324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.319396] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.319541] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.319815] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864257a8-cef2-40c0-879c-3676112514c0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.320277] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fb7a681-0823-49de-9892-747a25a5f324 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.320383] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.320450] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.320596] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.320665] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fb7a681-0823-49de-9892-747a25a5f324',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.321347] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.321506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.321506] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.321650] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.321924] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d200e885-c7ad-4101-b6e0-e3026ae4d35f',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.322513] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.322652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.322652] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.322811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.322878] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6be2818f-6bbe-47a1-a41d-086de5f4b5d0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.323561] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.323655] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.323722] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.323861] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.323931] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c33bec6e-2ebe-4c3c-a232-8a79edacefc8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.324597] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.324710] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.324774] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.324918] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.325053] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30a272b7-f056-46f6-bc0f-8e33fb6c2cd0',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.325729] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7af6783-0bd2-4e81-a95f-01929bc9267b taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.325833] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.325900] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.326058] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.326132] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7af6783-0bd2-4e81-a95f-01929bc9267b',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.326793] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.326935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.326935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.327093] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.327166] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc1efda8-467e-44a4-8d86-5f1d56a91f3c',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.327828] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae4b87ee-cc63-4241-b970-23c1a58e9362 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.327944] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.328108] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.328167] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.328221] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae4b87ee-cc63-4241-b970-23c1a58e9362',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.328936] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.329063] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.329111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.329269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.329384] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee0f66d6-515b-47ee-bcf1-99417ad55a0a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.329982] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.330114] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.330173] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.330297] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.330368] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86c8a328-51f3-46d6-a72c-f22aefa2fcf2',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.331019] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6b25007-70eb-4a46-96cf-27a55632b2b5 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.331128] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.331196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.331342] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.331437] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6b25007-70eb-4a46-96cf-27a55632b2b5',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.333539] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76bf622f-13b1-4d60-b853-8d93458e789a taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.333638] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.333708] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.333853] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.333925] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76bf622f-13b1-4d60-b853-8d93458e789a',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.334580] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.334742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.334742] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.334886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.334957] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.335631] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5028f4c-8816-49e2-a746-b352623465f8 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.335732] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.335776] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.335904] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.335975] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5028f4c-8816-49e2-a746-b352623465f8',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.336745] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.336745] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.336848] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.336911] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.337113] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.338059] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc5413e-0daf-404c-8ccc-94e28756a174 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.338059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.338059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.338059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.338059] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc5413e-0daf-404c-8ccc-94e28756a174',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.362885] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.363039] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.363111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.363318] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.384507] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.384703] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864257a8-cef2-40c0-879c-3676112514c0 is going to be deleted. [ 1524.440512] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.440743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.440743] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.440927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.441028] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.441154] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864257a8-cef2-40c0-879c-3676112514c0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.850089] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.850089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.850089] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.850435] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.850503] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.850615] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.850738] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.850850] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.851111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.851111] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.851111] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.923810] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.924059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.924059] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.924252] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.926732] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.926870] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.927499] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.927601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.928342] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.928448] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.929153] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.929256] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.929979] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.930079] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.931093] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.931186] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.931914] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.932099] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.933164] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.933294] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.934155] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.934278] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.934955] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.935062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.935639] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.936089] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.936179] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.936742] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.937126] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.937214] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.937853] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.938240] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.938324] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.938931] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.939309] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.939402] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.939971] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.940371] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.940465] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.941059] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.941446] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.941535] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.942108] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.942501] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.942595] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.948325] env[66123]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1524.948764] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.948876] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d200e885-c7ad-4101-b6e0-e3026ae4d35f is going to be deleted. [ 1524.949754] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.949961] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.972149] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.972322] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fb7a681-0823-49de-9892-747a25a5f324 is going to be deleted. [ 1524.973420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.973734] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.992264] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.992454] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc1efda8-467e-44a4-8d86-5f1d56a91f3c is going to be deleted. [ 1524.993259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.993471] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.014660] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.014831] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c33bec6e-2ebe-4c3c-a232-8a79edacefc8 is going to be deleted. [ 1525.015707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.015927] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.041905] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.042131] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.042786] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.042877] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.046907] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.047042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.051913] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.052043] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6b25007-70eb-4a46-96cf-27a55632b2b5 is going to be deleted. [ 1525.052901] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.053115] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.073550] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.073733] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86c8a328-51f3-46d6-a72c-f22aefa2fcf2 is going to be deleted. [ 1525.074601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.074827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.120014] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.120269] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.126929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.127115] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7af6783-0bd2-4e81-a95f-01929bc9267b is going to be deleted. [ 1525.128036] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.128262] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.324840] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.325275] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.327094] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.327225] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6be2818f-6bbe-47a1-a41d-086de5f4b5d0 is going to be deleted. [ 1525.328136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.328351] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.366160] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.392983] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.393167] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455 is going to be deleted. [ 1525.394018] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.394248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.398729] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.398863] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.419672] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.419929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.430812] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.430995] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae4b87ee-cc63-4241-b970-23c1a58e9362 is going to be deleted. [ 1525.431935] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.432178] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.509858] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.510110] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5028f4c-8816-49e2-a746-b352623465f8 is going to be deleted. [ 1525.510886] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.511106] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.512610] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.512758] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.586903] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.587144] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee0f66d6-515b-47ee-bcf1-99417ad55a0a is going to be deleted. [ 1525.587949] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.588172] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.603626] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.603883] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.613606] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.613827] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.622196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.622376] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb8f4e60-4319-40b5-a8f3-20680c5bcb74 is going to be deleted. [ 1525.623250] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.623454] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.648246] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.648494] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.792495] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.792680] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30a272b7-f056-46f6-bc0f-8e33fb6c2cd0 is going to be deleted. [ 1525.793561] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.793786] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.823707] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.823871] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc5413e-0daf-404c-8ccc-94e28756a174 is going to be deleted. [ 1525.824709] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.824929] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.868747] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2042273-fe02-491f-a396-b4a0546c4166: rpc.has_security_group_logging(os_id): False [ 1525.899373] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.899581] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.900162] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.900258] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.900959] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.901070] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.905352] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.905474] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dec317d-c042-4f12-bb65-cb7baa4f9905 is going to be deleted. [ 1525.906348] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.906579] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.968134] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.968326] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76bf622f-13b1-4d60-b853-8d93458e789a is going to be deleted. [ 1525.969181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.969461] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.030307] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.030591] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1932f921-51c6-4f18-8e91-2dc524b8516f is going to be deleted. [ 1526.031489] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.031714] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.031811] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.031920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d200e885-c7ad-4101-b6e0-e3026ae4d35f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.032095] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.032260] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.032339] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.032499] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fb7a681-0823-49de-9892-747a25a5f324" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.033072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.033257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.033343] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.033470] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc1efda8-467e-44a4-8d86-5f1d56a91f3c" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.033616] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.033771] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.033846] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.033953] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c33bec6e-2ebe-4c3c-a232-8a79edacefc8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.034102] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.034246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.034320] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.034430] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6b25007-70eb-4a46-96cf-27a55632b2b5" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.034564] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.034730] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.034820] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.034950] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86c8a328-51f3-46d6-a72c-f22aefa2fcf2" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.035097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.035240] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.035312] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.035424] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7af6783-0bd2-4e81-a95f-01929bc9267b" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.035569] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.035716] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.035790] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.035907] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6be2818f-6bbe-47a1-a41d-086de5f4b5d0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.036042] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.036181] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.036248] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.036360] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-672e609b-2b4b-4bf2-9f9b-2ca5ddb4b455" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.036480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.036620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.036763] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.036816] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae4b87ee-cc63-4241-b970-23c1a58e9362" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.036920] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.037072] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.037148] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.037257] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5028f4c-8816-49e2-a746-b352623465f8" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.037398] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.037521] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.037602] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.037704] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee0f66d6-515b-47ee-bcf1-99417ad55a0a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.037825] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.037968] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.038071] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.038158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb8f4e60-4319-40b5-a8f3-20680c5bcb74" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.038273] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.038420] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.048137] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.048381] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.049009] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.049136] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.067118] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.067377] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.130945] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.131301] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.131585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.131585] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.131800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.131800] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.131982] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2042273-fe02-491f-a396-b4a0546c4166 is going to be updated. [ 1526.132993] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.133196] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.133279] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.133449] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30a272b7-f056-46f6-bc0f-8e33fb6c2cd0" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.133546] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.133676] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.133775] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.133845] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dec317d-c042-4f12-bb65-cb7baa4f9905" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.134015] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.134162] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.134238] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.134345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc5413e-0daf-404c-8ccc-94e28756a174" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.198360] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.198620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.198620] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.198748] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.198819] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.198951] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76bf622f-13b1-4d60-b853-8d93458e789a" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.229716] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.229971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.229971] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.230151] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.230246] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.230368] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1932f921-51c6-4f18-8e91-2dc524b8516f" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.375875] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.376316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.376316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.376316] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.376480] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.393800] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: IN_PROGRESS for 2s [ 1528.410736] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: SUCCESS [ 1528.411158] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.316285] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.316509] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1534.317615] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1534.318032] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1539.319146] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1539.319549] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1544.319925] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1544.320476] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1549.321264] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1549.321648] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1554.322280] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1554.322683] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.323857] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.324262] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.201985] env[66123]: INFO networking_nsxv3.common.synchronization [req-79ad084a-3375-4c23-a001-fa61df527100 req-05491903-afa0-4f77-a9ab-d8ad6261b5ff tempest-AttachVolumeTestJSON-431749786 tempest-AttachVolumeTestJSON-431749786-project-member] Enqueued Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_members [ 1561.202537] env[66123]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2042273-fe02-491f-a396-b4a0546c4166 with Priority: HIGHEST for action security_group_members [ 1561.202860] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2042273-fe02-491f-a396-b4a0546c4166 taken with stack trace [, , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.202985] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.203062] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.203259] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.203414] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.203514] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.203567] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.203711] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.203795] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.203883] env[66123]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2042273-fe02-491f-a396-b4a0546c4166',) {} {{(pid=66123) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.706798] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.707069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.707069] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.707253] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.707345] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.707556] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.707659] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.707721] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.707862] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.707940] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.708036] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2042273-fe02-491f-a396-b4a0546c4166 is going to be updated. [ 1561.737275] env[66123]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66123) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.737601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.737601] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.737851] env[66123]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.738097] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.747356] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: IN_PROGRESS for 2s [ 1563.758448] env[66123]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2042273-fe02-491f-a396-b4a0546c4166 in Status: SUCCESS [ 1563.758836] env[66123]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2042273-fe02-491f-a396-b4a0546c4166 deletion is rescheduled due to dependency. [ 1563.758836] env[66123]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2042273-fe02-491f-a396-b4a0546c4166" {{(pid=66123) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.203722] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.204171] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.205224] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.205596] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.206270] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.206632] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.208097] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.208579] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.208975] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.209425] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.210346] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.210730] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.212287] env[66123]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.212287] env[66123]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0